United States Department of State 


Washington, D.C. 20520 


February 29, 2024 
Case No. FL-2023-00013 


Reed Rubinstein 

America First Legal Foundation 
611 Pennsylvania Avenue, SE, #231 
Washington, DC 20003 


Dear Mr. Rubinstein: 


As we noted in our letter dated January 31, 2024, we are processing your 
request for material under the Freedom of Information Act (“FOIA”), 5 U.S.C. 
§ 552. The Department of State (“Department”) has identified five 
additional responsive records subject to the FOIA. Upon review, we have 
determined that one record may be released in full and four records may be 
released in part. 


An enclosure explains the FOIA exemptions and other grounds for 
withholding material. Where we have made redactions, the applicable FOIA 
exemptions are marked on each record. Where applicable, the Department 
has considered the foreseeable harm standard when reviewing these 
records and applying FOIA exemptions. All non-exempt material that is 
reasonably segregable from the exempt material has been released and is 
enclosed. 


2 


We will keep you informed as your case progresses. If you have any 
questions, your attorney may contact Kevin Bell, U.S. Department of Justice 
Trial Attorney, at kevin.k.bell@usdoj.gov and (202) 305-8613. Please refer 
to the case number, FL-2023-00013, and the civil action number, 22-cv- 
03386, in all correspondence about this case. 


Sincerely, | 


Diamonece Hickson 
Chief, Litigation and Appeals Branch 
Office of Information Programs and Services 


Enclosures: As stated. 
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(b)(2) 
(b)(3) 


(b)(4) 
(b)(5) 


(b)(6) 


(b)(7) 


(b)(8) 
(b)(9) 


NR 


FOIA Exemptions 


Information specifically authorized by an executive order to be kept classified in the interest of 
national defense or foreign policy. Executive Order 13526 includes the following 
classification categories: 


1.4(a) Military plans, systems, or operations 
1.4(b) Foreign government information 


1.4(a) iniediiernemactividetosnoumiras qvinethods, OUSYRIeMeMe confidential sources 

1.4(e) Scientific, technological, or economic matters relating to national security, 
including defense against transnational terrorism 

1.4(f) U.S. Government programs for safeguarding nuclear materials or facilities 

1.4(g) Vulnerabilities or capabilities of systems, installations, infrastructures, projects, 
plans, or protection services relating to US national security, including defense 
against transnational terrorism 

1.4(h) Weapons of mass destruction 


Related solely to the internal personnel rules and practices of an agency 
Specifically exempted from disclosure by statute (other than 5 USC 552), for example: 


OBMPERVORG CESAR G OREO WO hey R USE rob!) Usc 403(2) 


EXPORT CONTROL — Export Administration Act of 1979, 50 USC App. Sec. 2411(c) 


FS ACT Foreign Service Act of 1980, 22 USC 4004 
INA Immigration and Nationality Act, 8 USC 1202(f), Sec. 222(f) 
IRAN Iran Claims Settlement Act, Public Law 99-99, Sec. 505 


Trade secrets and confidential commercial or financial information 


Interagency or intra-agency communications forming part of the deliberative process, 
attorney-client privilege, or attorney work product 


Personal privacy information 


Law enforcement nto ation whose ee would: 
fx XS mterfere with nforcement proceedin 


(B) deprive a person of a fair trial 

(C) constitute an unwarranted invasion of personal privacy 
(D) disclose confidential sources 

(E) disclose investigation techniques 

(F) endanger life or physical safety of an individual 


Prepared by or for a government agency regulating or supervising financial institutions 
Geological and geophysical information and data, including maps, concerning wells 


Other Grounds for Withholding 


Material not responsive to a FOIA request excised with the agreement of the requester 


(d)(5) 
GC) 
G2) 
(kK)(1) 
(k)(2) 
(k)(3) 


(96) 


(k)(6) 


(k)(7) 


Privacy Act Exemptions 


Information compiled in reasonable anticipation ofa civil action or proceeding 

Information maintained by the CIA 

Enforcement of criminal law, including efforts to prevent, control, or reduce crime or 
apprehend criminals, except records of arrest 

Classified pursuant to E.O. 13526 in the interest of national defense or foreign policy 
Investigatory material compiled for law enforcement purposes 

Regarding protective services to the President of the United States or other individual pursuant 
to Title 18, U.S.C., Section 3056 


Rawied by stattsita bennsieeradisndmard salpbcaxrtalatinaningeds ability, eligibility, or 
qualifications for Federal civilian employment or access to classified information, the 
disclosure of which would reveal the identity of the person who furnished information 
pursuant to a promise that his identity would be held in confidence 

Testing or examination material used solely to determine individual qualifications for 
appointment or promotion in the Federal service, the disclosure of which would compromise 
the testing or examination process 

Evaluation material used to determine potential for promotion in the armed services 
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From: state.gov> 

To: ae) state.gov> 

Subject: Re: DRAFT Email for DHS? Others? 
Date: Tue, 27 Oct 2020 19:03:50 +0000 


And giv ven 0%, of GNe ws si ffic comes from social media (80% of that from Twitter), all of 
isis pe for inauthenti or. 
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Subject: DRAFT Email for DHS? Others? 


See below as mentioned. 


NAM 
b)(5) 


Best Reg ards, 


‘ounter [Pisinformation Analyst | Russia Team 
Global Engagement Center 


BornldeRatMAPNati Sfroup 
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From{ _state.gov> 


Fw: FireEye Report: Alleged Russian 'NAEBC News Site and Personas Remain 
Active, Continue to Promote Content Related to U.S. Election 


Date: Fri, 23 Oct 2020 13:00:25 +0000 


Subject: 


- let's push this out to our election synch distro list which includes those agencies, as 
authorized below, if not covered separately via other I2C2 mechanisms. Thanks,fPxe | 
Fromfo@) state. gov> 
Sent: Friday, October 23, 2020 8:46 AM 

=F ussialeam@state gov> 
Ostate.gov>|\ 
mandiant.com>; GEC_DataAnalytics <GECDataAnalytics@state.gov>; GEC |2C2 
Internal <GECI2C2 Internal @state.gov> 
Subject: FireEye Report: Alleged Russian 'NAEBC' News Site and Personas Remain Active, Continue to 
Promote Content Related to U.S. Election 


Good Morning - 

Please see the attached FireEye finished intelligence report that was recently published to our 
FireEye Intelligence Portal. 

The report details continued information operation activity related to the U.S. election from the 
inauthentic news outlet “Newsroom for American and European Based Citizens” 

(NAEBC) despite the outlet’s public exposure in October as a site allegedly controlled by foreign 
actors. According to Reuters reporting on an alleged FB! investigation, the outlet is run by 
individuals associated with the Russian Internet Research Agency (IRA). We have also observed 
inauthentic personas affiliated with NAEBC remain active on the social media 

platforms Gab and Parler, including by promoting articles pertaining to the unverified New York 
Post story about documents allegedly obtained from the laptop of former Vice President Joe 
Biden’s son, Hunter Biden. 

This report is approved to be shared in FULL with US Federal Civilian Agencies and Departments 
to include DHS, FBI, USAGM, USAID etc. 

Approx. 1500 characters or two paragraphs of the report are approved to be shared with all 
other USG and FVEY partners outside of US Federal Civilian Agencies and Departments. This 
includes with the IC, DoD and combatant commands. If interested in this option of sharing two 
paragraphs more widely, |'m happy to assist with a derivative work product. 

Please let me know if you have any questions about sharing or the report content. Also 
interested in any feedback on the report! 

Thanks, 
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Global Engagement Center 
U.S, Department of State 
FireEye Inc. 


Dstate.gov> 
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ioe 
~~~ From: Ross Ewald 
To: [—-___estate.gov> 


EIP-536 Five Russian-linked or aligned proxy outlets amplify narratives surrounding 
Hunter Biden scandals. 


Date: Tue, 17 Nov 2020 07:23:06 +0000 


Subject: 


Ross Ewald resolved this as Oui of Scope. 


View request - Turn off this request's notifications 


This is shared with GEC anf] 


Powered by Jira Sarvice Management 


Sender: Ross Ewald 


Recipient: 4°} — |state.gov> 
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DISINFORMATION PRIMER 


This primer presents an overview of disinformation culture to give readers a sense of key 
concepts. terminology, select case studies, and programmatic design ceptions. Disinformation 
is by no means new, Althougn social media platforms have emerged as ihe most efficient 
spreaders of false information, disinformatian is also spread through analog media such as 
radio, ielevision, and newspapers. Il is, however, ihe combination of traditional analog 
media. in concert with new digital technologies, that allows information to soread faster and 
more broadly (even across borders) in unprecedented ways. Experts have described this 
phenomenon as "information disorder,” a condition in which truth and facts coexist in a milieu 
of misinformation and disinformation—conspiracy theories, lies, propaganda, and half-truths. 
They have labeled its ability to undermine democracy and individual autonomy “a wicked 
problem,” i-e., a problem that is difficult and complex, such as poverty or climate change. 
Despite the immensity of the challenge. there are promising ways that jaurnalisis. civil 
society organizations, technology specialists, and governments are finding te prevent and 
counter misinformation and disinformation. This primer presents several programmatic ideas 
to consider for standalone or integrative approaches as part of democracy and governance- 
related programming. 
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INTRODUCTION: HOW TO USE THIS PRIMER 


This primer is compiled with the intention of helping USAID staff'and partners to understand 
the basics of disinformation, how it is spread, why it is spread, and how programming can 
help reduce its damaging impact on societies around the world. itis organized into seven 
parts that each focus on illuminating the issue with insights from leading thinkers. 


These insights are supplemented with resources, case studies, and examples to illustrate 
different dimensions of the problem and to enable readers to pursue deeper discussions and 
resources that can help their programs and projects. The primer and its many annexes can 
be used as a guide or reference, and its modular design can supplement training programs 
aimed at different aspects of the disinformation conundrum. 


Photo: ©2018 Unsplash/Abhijith S. Nair 


l. PART ONE: WHY DOES DISINFORMATION MATTER? 


Part One explores how the well-worn and known tactics of disinformation are being adapted 
and used around the world. Evidence is mounting thal “false information can reach more 
people, penetrate more deeply into social networks, and spread much faster than any time in 
history.”! 


Experts from academia, government, civil society, and media agree that disinformation is a 
problem with social, political, and economic ramifications. A study Gone by Prevency, a 
German international consulting company for reputational risk and crisis management, found 
that disinformation costs the global economy $78 billion per year, including in share price 
loss, brand reputation management, and investment in political disinformation campaigns.* 


USAID staff and partners around the world need a working knowledge of the scope and form 
of disinformation since it impacts many levels of programming and interventions across all 
development sectors. While it is daunting to define terms, this primer provides key 
terminology and tools to better identity ways to counter and prevent it. 


Disinformation comes from both homegrown and foreign sources. Foreign Policy noted in a 
recent article that "as research has increasingly shown, homegrown disinformation is making 
democracy sicker than any foreign efforts can.”* The article goes on to point out: 


USAID.GOV DISINFORMATION PRIMER | 2 


FL-2023-00013 A-00000748592 "UNCLASSIFIED" 2/27/2024 Page 12 


FOR INTERNAL USE ONLY 


“There are immense incentives for disinformation buill into democratic institutions 
themselves. Treating disinformation as an alien disease ignores the fact tnat it is 
perfectly compatible with democratic norms and thrives inside democratic states. A 
recent report’ by tne Oxford Internet Institute, for example, found that politicians inside 
45 democracies have used social media for 'amassing fake followers or spreaging 
manipulated media to garner voter support. ~” 


Disintormation is a core challenge fer democracy, rights, and governance promotion, yet it is 
not the only problem. Other key information challenges include censorship and freedom of 
expression; internet freedom and digital rights (including thrott!ing and internet shutdowns); 
political polarization; and the demise ol traditional journalism business models and related 
new challenges of the financial! viability of the news industry in the digital age. Each of these 
chalienges creates fertile ground for, or amplifies disinformation by, limiting the free and 
cpen access to facts, data, and information in our societies. 


As the spread of disinformation online has grown rapidly in recent years. global internet 
freedom has been declining rapidly (for the ninth year in a row in 2019). Since 2016, 
Freedom House nas reported on new governments contributing to the spread o7 
disinformation. Freedom House also has observed new malicious actors taking advantage of 
the failure of democratic states to successfully regulate online campaian finance and 
transparency rules that are essential for nemocratic elections. This trend is worrisome. Many 


mere democratic leaders are employing this strategy domestically. |n this way. democratic 
governments are also falling prey to state-sponsored disinformation because tney cannot 
use more draconian methods to exercise power. 


Additionally, repressive governments nave gained access to new tools to collect and track 
data on entire population sets and are utilizing them to effectively increase popular support 
for thernselves. They use social media surveillance tools and artificial intelligence to “identify 
perceived threats and silence undesirable expression.” This trend has created an 
environment where civil rights are being abused and activists are being repressed and 
denied the possibilities of the digital sphere for a variety of religious. social, and political 
speech. Of the 65 countries Freedom House assessed in 2019 in its Freedom an the Net 
Report, 47 (the highest number to date} have arrested online users for religious. social, or 
political posts, Such cocptation and control of the digital space [further allows authoritarian 
leaders io engage in domestic disinfarmatian campaigns more easly and widely. 


A. DISINFORMATION, MISINFORMATION, AND MALINFORMATION 


Disinformation, or information that is shared with the intent to mislead people, is 
increasingly a. global phenomenon. Il has become more prevalent with the rise of social 
media and tne digital economy and a lack of digital and media literacy among consumers of 
online media.® Disinformation is often used as a catch-all term for all false information. but it 
is distinguishea from misinformation by its purposeful intent to deceive. Misinformation, on 
the olher hand, is false information spread by someone who believes false information 
to be true. (See Figure 1.) The impact of disinformation and misinformation can be the 
same.’ Whether false information is shared intentionally or not, it is still dangerous. 
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Additionally, 

“malinformation” is Figure 1: Information disorder 

deliberate publication of 

private information tor 

personal or private interest. 

as well as the deliberate FALSENESS INTENT TO HARM 
manipulation of genuine 
content. This is often done 
by moving private or 
revealing information about 
an individual, taken out of Misinformation Disinformation Malintormation 
context, into the public Ucmntentionad Fabricated ov Deliberate 
sphere. misteies such as nediberatety publication of private 


inecourate photo manipulated information for 
captions, dates. audio/visieal personal or 


Qacas reharc ganrorriecec 


FPN rere CAP AP Tet ae BA AAR rs conte COMmpora. & faiver 


disciplines nave shown ina Interticrinty created public interest. such 
. Soiracy theaneés ‘revenge por 
variety of ways how priate whale 
i de . rumors Deiiberale cnange of 
networked disinformation context, dates or 


capitalizes on predictable ssc reamnae 
human behavior in digital fs 

spaces. In a Massachusetts 
Institute of Technology 
(MIT) study, researchers 
found that talse a 
information travels on Source: https:/intarnews. org/impac disinformation 

average six times faster 

than authentic, true new 

stories. The study's data snowed false information “diffused significantly farther, faster, 
deeper, and more broadly than the truth in all categories of information,” suggesting people 
are more likely to share false stories for their novelty and because they “inspire fear, disgust, 
and surprise in replies.” Media literacy, or the ability to methodically consider the 
meaning and source of a post or news article, is the most important factor in identifying 
false or misleading news. As a Yale University study found, “Susceptibility to fake news 
[false news] is driven more by lazy thinking than it is by partisan bias per se.” 


B. DISINFORMATION AND ITS IMPACT ON DEMOCRACY, RIGHTS, AND GOVERNANCE 
Posing an existential threat to democracy, the 


spread of misinformation and disinformation is “We need to be as cautious about 
having an “absolutely corrosive” impact on the our information hygiene as we are 
institutions and norms that enable democratic about our hand hygiene, for the 
governance.® The impact it has on prospects for sake of public health and 
democratic development is an urgent matter for democracy. 

those involved in strengthening democratic —Joyce Fegan, Irish Examiner, 
institutions, Ideally, in a healthy democracy, September 19, 2020 


citizens and policymakers can draw from a 

common set of facts to deliberate and make 

decisions. In an era where mis- and disinformation is so prevalent, democratic progress and 
order is threatened by faulty information—conspiracies, lies, half-truths, distortions, and 
propaganda. 


Most worryingly, disinformation is a significant force that can undermine democracy and 
good governance, free and fair elections, access to information, rule of law, protection of 
human rights, independent media, and civil society action. Critical to every aspect of good 
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governance, information integrity enadles 


political parties to debate and share ideas, Four ways in which disinformation 
concerns, and solutions. It opens opportunities impacts democratic development 
for citizens to influence public policy dialogue. It ; 7 
promotes economic innovation as - Interteres directly with the ability 
entrepreneurs refine and improve on the goods of democratic societies to 
we produce. And it enables governmenis to determine what is in the public 
respond effectively to public health and other interest through open discussion 


emergencies. - Leads to a loss of information 


integrily and offen tc impediments 


Democratic societies rely on journalists. media of press freedom 

cutlets, and bloggers to help shape local and - Can interfere with civic society 
national dialogue. shine a light on corruption, and distort political engagement 
and provide truthful. accurate information that - Exacerbates polarization and 
can inform people and help them make the social fracturing 


aecisions needed to live and thrive. Yet, the 

public sphere has taken on an increasingly toxic 

and polarized quality. The nature of now people 

access information is changing along with the information technology boom and the decline 
of traditiona! print media, Because traditional information systems are failing, some opinion 
leaders are casting doubt on media. which, in turn, impacts USAID programming and 
funding choices. 


Our iechnology-enabled society, with all tne vaunted benefits of increased connection, 
efficiency. and transparency, has also led to erosion ef individual privacy, trolling, 
cyberbullying, cyber or information warfare, and dubious and deceittul abuse and misuse of 
tech platforms in deliberate efforts to erode democracy and public trust and extort money 
and power. As numerous scholars have argued, tech platiorms have preverred profit over 
their users, failing to provide even basic controls to nelp support civic engagement over 
extremist speech. Indeed, studies such as Siva Vaidhyanathan’s Antisocial Media: How 
Facebook Disconnects Us and Undermines Democracy demonstrate that social media 
platforms find extremism far more engaging—and hence more profitable—so their platform 
design encourages it.’ 


Today's digital communications and media landscape is complex and has given rise lo a 
new set of challenges and considerations for democracy support. Across all USAID 
programming countries, this requires a solid understanding of disinformation ang robusi 
approacnes fer countering and preventing it. 


Two current examples from Brazil and Myanmar illustrate the threat posed to democracy by 
rampant disintormation. The way in whicn disinformation is manifest is very much context 
based, One must consider how information is consumed in a particular country or 
community. For example, in Myanmar effective information manipulation relies on Facebook, 
which is almost synonymous with the internet since it is provided free with a mcbile phone 
data plan. Recent developments with the Myanmar military displacing civilian leadership in a 
coup in January 2021 have underlined issues of internet freedom and disinformation. 
Likewise, in Brazil. cheap data plans that only include access to the likes of WhatsApp and 
Facebook makes citizens more likely to consume sccia! media in which false claims are 
echoed by unreliable sources. 


Disinformation impacts the prospects for democratic development in a number of ways: 


1. It undermines trust in democratic institutions by reducing their credibility and 
legitimacy in the eyes of the public. Disinformation imerferes airectly with the ability of 
democratic societies to determine what is in the public interest by dominating and 
disiorting the public discourse and corrupting the process of democratic decision-making. 
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The spread of disinformation is a tactic thal authoritarians use lo dominaie people and 


societies. '' Governments also sometimes use i! as a tool of foreign policy.'® When the 
strategy leads to political success, it provides motivation for the winners to restrict the 


oo 


Tee NOW OF INTOFMANON Dy Those WhO WOUIO Gispule Mem and 10 UNGerMINne CONSMUNONAl 
protections for free speech. 


It leads to a loss of information integrity. Online news platforms nave disrupted the 
traditional media landscape, Government officials and journalists are not the sole 
information gatekeepers anymore. As such. citizens require a new level of information er 
media literacy to evaluate the veracity of claims made on the internet. False beliefs 
spread across the internet because almost anything is being promoted by someone. 
Autneritarian \eaders add to the loss of information integrity by delegitimizing the media, 
claiming news sources are faulty or corrupt, i-e., the weaponization of “fake news." The 
loss of information integrily itself further undermines trust in the media's ability to provide 
fact-based information. It leads to a loss of press freedom. The weaponization of "fake 
news” (calling a partisan cr atnerwise opinion-heavy article or outlet “fake news’ in order 
to discredit It} has also led some governments to propose or pass ant! ‘fake news” bills, 
which have had a chilling effect on freedom of speech and are used to target or siience 
independent media. 


It can distort political and civic engagement. Social media platforms offer democratic 
benefits by connecting citizens with each other in ways more easily possible in a digital 
space, encouraging voter turnout, and giving voice to minority viewpoints. However, in 
conjunction with disinformation, tne same platforms can provide the means for 
suppression of civic and political engagement. The use of trolls, doxing, flooding, and 
other tactics have resulted in a dramatic reduction in constructive social and pelitical 
engagement. Simple widespread mistrust about the accuracy and authenticity of online 
information may be enough to demotivate political engagement." 


lt exacerbates polarization and social fracturing. In‘ormation technology creales 
many opportunities to engage witn and learn from different perspectives, On the other 
hand, new information tecnnology has been used to reinforce stereotypes and create 
insular communities with similar values, histories, and experiences, providing a home fer 
disaffected populations to sromote their own views. This is further complicated by “filter 
bubbles” and “echo chambers" created by social media, in which false claims are 
repeated and magnified, increasing polarization and making democratic discourse more 
difficult as citizens iurn to different sets of false information as tacts. 


It can have a disproportionate impact on marginalized populations, resulting in 
online violence, intimidation, and harassment using false narratives. Disinformation 
on social media often involves targeted harassment campaigns that seek to silence and 
marginalize opposing cpinicns and/or specific groups in society, sucn as women or 
ethnic groups, and make it appear that disinformation actors preside over greater 
consensus. Such harassment and attempts to silence voices have been used to 
discourage and discredit women candidates for polilical office in many countries. 


USAID.GOV DISINFORMATION PRIMER | 6 


THIS WERE® 


PART TWO: UNDERSTANDING INFORMATION 
DISORDER 


Although disinformation has become a hot button issue over the past Several years, the 
manipulation of media has been used as a political tactic in the past and is by no means a 
new phenomenon, Information disorder, a term coined by Claire Wardle’® an expert on 
misinformation and disinformation and co-founder of First Draft, refers to the current media 


climate and the ways in which the media ecosystem is polluted. '’ 


Photo; ©2017 Unsplash/Kayla Velasquez 


This term offers an alternative to the term “fake news," which has been coined and promoted 
for political purposes. As noted by The Conversation, “Not only do different people have 
opposing views about the meaning of “fake news,’ in practice the term undermines the 
intellectual values of democracy and there is a real possibility that it means nothing. We 
would be better off if we stopped using it."'> Furthermore, as noted by assistant director 
general of communication and information at UNESCO Frank La Rue: 


“Fake news is a bad term primarily because it is a trap. It is not news. Just the term 
generates mistrust of the press and of the work of journalists. Political leaders have 
staried using the term against the press, which Is especially serious. This is a crucial 
moment when we have to defend journalism. We have to promote a journalism of 
honesty, a journalism that is seen to build the truth." 


Information disorder, A condition in which truth and facts coexist in a milieu of 
misinformation and disinformation—conspiracy theories, lies, propaganda, and half-truths. In 
tact, Groundviews identified 10 types of misinformation and disinformation. (See Figure 2. 
First Draft News also prepared illustrative examples of each type: see Annex 2: Types of 
Misinformation & Disinformation, to study them.) 


The threats of information disorder have worsened as social media and internet use become 
more ubiquitous and as digital technology writ large has taken on a bigger role in democracy 
and governance programming. It is a central area of study to understand how and why there 
has been such an expansive erosion of democracy over the past 10 years°—since 2010, 
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Information disorder has 
impacted nearly all facets of 
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Figure 2: Groundviews’ series on media literacy 
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media. The ubiquity of mobile 
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access without financial cost = SPONSORED [x] ERROR 
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websites users can access.”? 


Notably, in Myanmar, 
Facebook has come under fire 
for its role in spreading 
disinformation exacerbating 
hate speech and contributing 
to widespread unrest and 


Source: hitos://groundviews.org/20 1 8/05/11 2/infographic-10-lypes-ol- 


mis-and-disinformation/ 


reporting 


GROUNDVIEWS 
hl ee 


violence. In fact, the Office of the United Nations High Commissioner for Human Rights 
called out Facebook for its role in propagating hate speech and inciting the violence that led 
to the 2017 genocide of the Rohingya people, which resulted in the deaths of more than 
24.600 Rohingya Muslims by Myanmar's state forces. The hate speech leading to the 
genocide spread quickly via online channels and was not shut down due to a lack of 
Burmese-speaking content moderators on Facebook. According to Reuters, Facebook only 
had two Burmese-speaking content moderators in 2015, despite repeated warnings that the 
online media platform was contributing to viclence against the Rohingya people. In 
response, the United Nations set up an Independent Investigative Mechanism for Myanmar 
in 2018 to collect evidence for use in future prosecutions. As reported by Malay Mail, “UN 
investigators said Facebook had played a key role in spreading hate speech that fueled the 
violence. Facebook says it is working to stop hate speech and has deleted accounts linked 
to the military including senior army officials but preserved data.”“* 


Key to the current debate about the disinformation problem is the role that social media 
plays as a vector for disinformation. The rise of social media use and online content creation 


information has resulted in a media-saturated world, one that requires a fairly high level of 
critical thinking from users and consumers—i.e., digital literacy and media literacy. 
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Although social media was designed to 
connect us, societies were not prepared for 
its abuse. |he prevalence of online and social 
media has opened the door for bad acters to 
use coordinated campaigns to promote and 
manipulate distorted information for their own 
ends. The proliferation of coordinated 
inaulhentic activity online greatly threatens 
the free excnange of ideas and information 
that democracy is duilt on while 
simultaneously challenging societies that are 
still in the process of developing demecratic 
governance. 


Both wealthy and developing countries nave 
siruggied to adapt to the large amounts and 
variety of misinformation and disinformation 
circling on the internet. However, in 
developing countries. the results can be both 
life-threatening, as well as detrimental te 
democratic governance. |n extreme cases, 
misinformation ana disinformation has led to 
violence against ethnic minorities and 
impacted the outcome of elections. 


Annex 3: Emerging Solutions, provides links 
to some of the key research centers working 
cn information disorder that regularly put out 
guides, toclkits, newsletters, and webinars. 
This research focuses on helping differentiate 
between the real and the take online. These 
are useful for those working to debunk false 
news and promote factual. truthful 
information. 


A. WHY PEOPLE USE DISINFORMATION 


Civil society can play an active role in 
countering the type of malinformation 
{nat comes in the form of hate 
speech. In 2014, the Flower Speech 
campaign (also known as the 
Panzagar campaign) was launched to 
counter hate speech in Myanmar in 
response to the rise in in anti-Muslim 
violence. The Flower Speech 
campaign was founded by Nay Phone 
Lalt, executive director of Myanmar 
ICT for Development Organization, 
who was himself sentenced to more 
than 20 years in prison in 2008 for 
blogging about the 2007 Saffron 
Revolution, In the flower campaign, 
hate speecn is countered by efforts te 
promote responsible use of social 
media and raise awareness of the 
implications of online behavior. 
Through partnerships with local 
graphic designers and Facebook to 
create a set of positive ‘cigital 
stickers’ that users can share on the 
social media platform, the movement 
has |ed to some users posting photos 
of them holding flowers to further 
spread the message of peace. 

Source: Frontier Media, 


https./Avww.frontermyanmar.neten/arotile- 
the-flower-sseech-movement/ 


According te research publisned by Psychologica! Science in the Pubiic Interest, some 
reasons that use of misinformation is so rampant include: 


e Rumor: Societies have struggled with the misinformation-spreading effects of rumors for 
ceniuries, if not millennia—what is perhaps less obvious is that even works of fiction can 
give rise to lasting misconceptions of the facts. 


# Politics: Governments and politicians can be powerful sources of misinformation, 
whether inadvertently or by design. 


e 6 Vasted interests: Corporate interests havea lang and well “documented history of 


eat eS Sates ‘Sede She | oS Sie 


SCORITIG LO TINUCrIC® PUD CGeDale DY PIOMIUIGGUNY HICGIOCU MOTT atOn, Aa aot OM 
some recent occasions, such systematic campaigns have also been directed against 
corporate inierests., by nangovernmenial interest groups. 


e Media Fragmeniation: [hough the media are, by definition, seeking to inform tne public, 
it is notable that they are particulary prone to spreading misinformation for systemic 
reasens that are worthy of analysis and exposure. The internet and the growing use of 
social netwerks have fostered the quick and wide dissemination of misinformation. The 
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fractionation of the information landscape by new media is an important contributor to 
misinformation's particular resilience to correction.*° 


Additional reasons information disorder is on the rise include: 


e The erosion of trust in institutions, especially government and media institutions.” 
Environments where trust is low are ripe for the spread of disinformation. 


e Misuse of technology, through bots and cyborgs spreading disinformation.*’ 


In the political sphere, the ability to win elections is now correlated with a political actors’ 
capacity to manage social media platform messaging. For example, Ukraine's staggering 
landslide election of both President Volodymyr Zelenskyy and his Servant of the People 
Party in 2019—sweeping away 80 percent of all Members of Parliament (MP}—was based 
on almost no concrete policy formulations. Zelenskyy built a formidable campaign machine 
based on social media and a fictional characterization he embodied (as Ukraine's president 
in a comedic television series) that his opponents 

could not match. 


This use of disinformation has played a central role in 
the deterioration and backsliding of democracies 
around the world.*® Governments and others who 
propagate information disorder have created social 
fissures, contributing to a breakdown of public trust in 
government institutions and media. This effectively 
destabilizes and fractures the civic institutions that 
once upheld/demanded transparency and 
accountability in political discourse, As the 2020 
Edelman Trust Barometer Report finds, 76 percent of 
a global data sample agreed with the statement, “| 


worry about false information or fake news being Source; EuroMaidan Press -- 
” wit j } ; ? ia. 
used as a weapon. 2g hitp://euromaidanpress.com/2017; 12/15/a 
guide-to-russian-propaganda-part-4-russian- 
propaganda-operales-by-law-ol-war/ 


Figure 3: Russian produced 
meme to persuade Ukrainians 
against Euro-integration 


B. HOW TO IDENTIFY DISINFORMATION 


Figure 4, below, was developed by ProQuest to assist in the steps for identifying 
disinformation.* It is very useful to consider when confronted with a news article, 
social media post, or email that contains claims that seem dubious. While being adept 
at spotting the different types of false content takes practice, it does become easier. (See 
Annex 3, Emerging Solutions, for more resources on learning how to identify disinformation.) 


C. CONTEXT AND SOCIAL FACTORS OF DISINFORMATION 


In assessing a society's risk for problems associated with intormation disorder, it is vital to 
consider several contextual and social factors, such as issues of age, gender. and other 
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marginalized groups; access to 
technology and the internet; levels 
of political polarization in society: 
and legal norms related to content 
reguiation that may impact how 


issues like hate speech are dealt 
with. 2. identify the News Outlet 


The Wall eeet Jona and Cis we enarmplet of meet cutlets M you havent head of 
he fares Octet Reach onl ne tk more efor ator 


is the neers cutiel well known, well reupected, and trurterorthry? 
3. Check Une Web Domain 


Many lake news VEL: loud ockd oF ond ath ‘com co’ or lo’ fog 


Figure 4: Step-by-step guide to combatting 
disinformation 


1. Do a Visual Assessment 


Abels Dw Over at Gengn Fate Cows & Les oflen look arnt Rawe lots of 
BARoyeg ah, 2nd vie aus ed oF blolen wnagest 


Overad, does (he news article and webtile seem high quailty? 


Rise of digital technology 


Digital technology has supplanted 
many of the forrns in which people 
lraditionally obtained information. 
With the rise of the number of 
platforms and use of digital 


Bde: Pelrer 8. COAT. CO) LO PNET hegrleTe tater idee 
Does Use URL seem bepeienete? 


4. Check the “About Us" Section 


Trenterin hp fare OeAT es ch nally A Inet Chet ahd DAC GTO ONAL Dele » 
tialersets ard eric? ( ovtatts is tne “About Abe Ut $x Gor 


Does Une ste provide detaited beck pround information and contacts? 
5. identify the Author 


Fake fees arlahes Often dont nchede author named of anchabed Laarch the author t 
Nene ormne to hae # he OF We 6 pret BAe od /etpe ted 


Goes the orticie here a trusted avihos? 
6. identify the Central Message 


Redd the alate CleeAully Fake Manet detatied offen goth Oem yepeptonht, Amen deh 
ayy tone of make ou V aged Cig 
Does Use orlicte seer fair, Dabented. and restonabée? 


technology, consumers now 
remain more exposed to 
disinformation. Trends that 
contrinute to this challenge are: 


Digital technology has become the 
norm among peopie across the 
globe: 7, Assets Spelling, Grammar, and Punctuation 


Vf the arches bt tapelied acral wordt © ALL Cals poor grammar oy Ou of 
> probly uel ae 


Does Ue aruicke heve proper ipelling, grammar, end punctuetson? 
6. Analyze Sources and Quotes 


Corcedier (he ori-cie s sources and who a Quayle fake cewt orbicies offen cle 
Mohiymawt Mariet attehstle bowiet Of 1 Letes Of a, 


Does Une articie include and ident ity reliable sow ces? 
9. Find Other Articles 


Search the wtarnet ot mote atClet OF The tare (ope poe Cant Tid any 
Chattet iva the Lory 2 fone 


ave there multipie articles by othet naw outiots on this lopic ? 


10. Turn to Fect Checkers 
chery trope: com Bolt acl com ate medety Uutied fact checking 
fe 


Oo Une fact checkers amy the mews slory is true? 


e Global internet penetration is 
currently at 53 percent.?! 


e More than five billion people 
have mobile devices, and over 
half of hese connections are 
smariphones: a median of 76 
percent across 18 advanced 
economies surveyed have 
smariphones, compared with a 
median of only 45 percent in 


emerging economies.“ 
Source’ https:!‘bleas creavest cormiuwe- 


in many societies, the amount of conlentuolaads‘207 7/01/Fake-News?) .odf 
time spent online has skyrocketed: 


e |In2019, the average time soent on the internet was 10 hours in the Philipines, 9.3 
hours in Brazil, 8.25 hours in Scuth Africa. 7.5 hours in the U.A.E.. 6.3 hours in the 
United States. and 5.5 hours in China.?? #4 


The growing dominance of social media as a source of information is happening all over the 

world: 

@ On Twitter. a total average of 500 million tweets are posted daily; on Facebook there 
were 1.63 billion daily active users in September 2019.* 


e India alone is home to 290 milion Faceboox users. To put this into perspective, if India’s 
Facebook users were a country. its population would rank fourth in the world.* 


e More than 70 percent of internet users in Kenya, South Africa, Bulgaria, Chile, Greece, 
and Argentina get their news fram social media.*’ 


The pervasiveness of Facebook's Free Basics Internet.org—which provides a pared-down 
ceil phone internet experience providing access to mainiy social mecia—has afiecied 
infernet usage. Social inedia is becoming synonymous with the internet: 


USAID.GOV DISINFORMATION PRIMER | 11 


FL-2023-00013 A-00000748592 "UNCLASSIFIED" 2/27/2024 Page 21 


FOR INTERNAL USE ONLY 


® In many countries, such as Sri Lanka ano the Philippines, “opening the internet’ on a 
digital device means opening Facebook. In 2014, Quartz found thal 65 percent of 
Nigerians and 61 percent of Indonesians surveyed agreed with the statement: 
“Facebook is the internet."™ 

e The Philippines, for example, is a good illustration of how Facebook has penetrated 
into the social structure: “Free Basics was launched in the Philippines in 2013. By 
2018, almost two-thirds of the country’s 110 million people were using Facebook, 
according to Buzzfeed. |n the Philippines, the word ‘Facebook’ is interchangeable 
with ‘internet, writes Maria Farrell.“° 


Though the platforms may change, the problems that social media brings with it remain the 
same. WhatsApp, now owned by Facebook, is also making significant headway globally. 
WhatsApp remains a widely used platform outside of the United States for information 
sharing, However, WhatsApp's encrypted, and non-public nature makes it difficult to 
research and analyze. 


* According to a survey conducted by Reuters in 2017, WhatsApp has become one of 
the leading news sources in Brazil, Malaysia, and Spain, nearing 50 percent of the 
population who say they use it for their main news source on a regular basis.” 

e According to Digital Information World.’ WhaisApp has 1.5 billion users from 180 
countries, which makes it the most popular instant messaging app worldwide. 
(Facebook Messenger is in second place with 1.3 billion users.) 

e WhatsApp has one billion daily active users, The biggest market for WhatsApp in 
India with over 200 million users; Brazil has 120 million users. 


ESSEN GER AP? BY UNTRY 


~ .. we 
© Hootsuite ore. 
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DIGITAL AROUND THE WORLD IN 2020 
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Cross-Cutting Issues 
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issues, such as gender and youth, that In many emerging economies, younger people lead 


are important to link with how people they Soe — 
% of adilts iho own a smartphone 
choose to counter and prevent . ~ 
disinformation in their society. ah egoenag 
Mis-34 50+ 
AGE Brae india indonesia Kenya 


One of the key questions that needs to < ee 
be considered in terms of countering 


and preventing disinformation is iy OF oy 
whether there are generalional m8 eet OM 
differences in terms of news oS) aS ee | ae 


consumption, susceptibility to false 


news and information, and access to sia i eee: een 
and ability to use technology. For rr va 
instance, around the world, younger acai = f- » Pr i 
users with a higher education level ap 89 31 7 as 
and higher moore are more likely to wo —. ae 1g al 
have smartphone access than their = Ue Oe eS Oe | 
elders.*” However, statistics show that 

older people have rapidly caught up ipl opscacdie > trou dis cl alguna 


and, when they cannot, they often rely PEW RESEARCH CENTER 

on younger users to access the 

information they need. Moreover, some studies have shown that people aged 65 and older 
are almost four times more likely to share false news on social media than younger people 
and that in some instances they are more responsible for the spread of 
disinformation.**Social science research is increasingly interested in the question of whether 
the consumption of false news is a matter of generational differences. One study found that 
age plays a key role and has a strong effect on the dissemination of false news. According to 
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the study (Guess, et al.), ‘on average, users over 65 shared nearly seven times as many 
articles from fake news domains as the youngest age group.” 


Ina US. study conducted by College Reaction, 69 percent of Gen Z (born mid-1997 to early 
2012) students claimed it is somewhat or very easy to discern between true and false 
information online.** However, a majority of middle schoolers in the same generation could 
not determine the difference between an advertisement and a news story, while 30 percent 
of the surveyed students found a fake news story to be more credible than a real story.** The 
U.S. experience, however, differs drastically from youth in Finland where children in primary 
and secondary schoo! are taught about media literacy as a core part of their education, and 
beneficiaries from Finland's whole of society approach to the disinformation problem. 
Finland’s government launched an “anti-fake news” initiative in 2014 “aimed at teaching 
residents, students, journalists and politicians how to counter false information designed to 
sow division.” 


Some studies have shown elders, who may have less facility with digital technology, to be 
more immune to disinformation because they rely on other forms (books, education, 
experience) to assess the validity of claims.“ Still this bias, coupled with a decrease in 
memory, may also hinder their ability to discern disinformation.” 


GENDER 


In the Global South, women and men often experience digital technology very differently; 
however, they use It almost equally in both advanced and emerging economies.*° Where 
resources are thin, families often do not have the time or money for women to have access 
to the internet. Moreover, il is often true that women often have less access to the internet 
because of local gender norms. 


wit 


73% of women journalists ~\y x? 


GF, 
participating in a UNESCO/ICF) survey ¢ Vv. 
say they have experienced online violence 


in the course of their work. 


International Center | 
ICKi for Journalists #JournalistsToo 


Furthermore, in the spread of disinformation, gender has often been exploited by autocrats 
and those in power to discredit journalists and eliminate government critics.*’ Female 
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journalists across tne Middle Fast nave been repeatedly targeied with doctored photos of 
them in sexually compromising positions, claims that they achieved their jobs by being 
sexually promiscuous, and online defamation campaigns that utilize misogynistic language 
to discredit them and their news coverage. For more information on this. especially on how 
women politicians are disproportionately affected by false news, see the Council on Foreign 
Relations report on Gendered Disinformation, Fake News, and Women in Politics.“ 


In India, journalist Rana Ayyub was slandered oy fake images ano tweets insinuating that 
she was a porn actress.” The coordinated attacks occurred afler Ayyub began fighting for 
the justice of an 8-year-old girl who was raped over several days and then murdered, The 


doctored video of Ayyub was shared over 40,000 times. including a share by the ruling 
nationalist Bharatiya Janata Party's {BUP) fan page. It ultimately sent her to tne hospital for 
heart palpitations and anxiety.°* 


Stories ike this are examples of an overall climate tnat contributes to the discrediling 07 
female journalists, violence against them, and the danger of covering women's issues in 
general. A Reporters Without Borders report on violence toward journalists covering 
women's issues found that of all forms of violence and retaliation against these journalists 
about 40 percent is cyber harassment specifically.* Itis also worth noting that online 
violence often accompanies physical violence.*’ 


HATE SPEECH AND DANGEROUS SPEECH 


Hate speech and dangerous speech are consicered a potentially life-threatening aspect of 
information disorder, 


The definition of hate speech is offen contested, particularly because il is such a Charged 
tonic, and legal and social organizations offer alternative definitions for the same act. Tnis 
tonic is particularly controversial because there tends to be fine lines drawn in democratic 
societies regarding what is considered acceptable free speech and what is net. Some 
definitions consider hate speech a verbal attack made on a group based ona snared identity 
while others agree that an attack on an individual can be considered nate speech. 
Likewise, some definitions insist that specific identity markers must be included in hate 
speech (such as membership in an ethnic or social grouping) while others aadress any 
attack on identity.* 


PeaceTech Lab defines hate speech as a deliberate attack or expression that vilifies, 
humiliates, and discriminates against others based on their ethnic, national origin, religious. 
racial, gender, sexual orientation, age. disability, or other shared identity, This can |ead toa 
larger societal impact influencing acts of violence.* Hate speech is rooted in larger social 
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grievances Ihal are potemially incendiary 
and often lead to serious violence and 
injustice and new research indicates hate 
incidents online and offline peaking in 
tandem.” 


Another term. dangerous speech, is any | 
; MESSAGE 
form of exnreesion (sneech.§ tes or 


Figure 5: The dangerous speech five-part 
framework 


imaged) that can increase the risk thal ils 
audience will candone or panicipate in 
violence against members of another 
group. The Dangerous Speech Project has 
put forward a framework that considers the 
speaker, the audience, and the medium, as 
well as the message and context in 
determining risk—which is an interesting 
comparison with the distinction between 
misinformation and disinformation (i.e., 
intent versus other facters). Disinformation 
is also explicitly a category of dangerous 
speech, where it has the capacity to lead to 
violence and other types of harm.** 


S3..47°°3— 


Understanding how to recognize hate 
speech and dangerous speech is 


SOCIAL AND 
HISTORICAL 


CONTEAT 


Source: nttps;dangerousspeech.arq/quida/ 


particularly important to combatting their spread online througn platforms like Faceocok and 
Twitter, where hate speech and disinformation are often tightly linked. 


It is worth noting the concerns about hate speech in the context of conflict {pre or post), A 
noted example is the Radia des Milles Collines in Rwanda, which called for direct attacks 
against tne Tutsi minority and for which the journalists of that radio were ca/led before the 
Hague and charged with crimes against humanity. Hate speech, particularly in fragile states 
marked by conflict, can |ead to violence and other harm so it is essential fo understand the 


challenges for labeling hate speech as such. 


D. FOREIGN-SUPPORTED INFORMATION DISORDER 


The geopolitical dimensions of information 
disorder are another key contextual factor to 
understand, Disinformation is a long-practiced 
means of statecraft. One of the common forms of 
disinformation comes from governments and 
political actors that are working to gain influence. 
Both the Government of Russia and the People’s 
Republic of China have used disinformation 
tactics to misinform, change narratives, and 
accumulate further support for their foreign 
policies. However, the respective governments 
approacn information wartare in very different 
ways. One key difference is that Russia focuses 
primarily on information manipulation while China 
employs censorship and other forms of 
information control to suppress other viewpoints 
and cantrel the narrative.*° 
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“We've seen quite a significant uptick 
in misinformation generated by 
foreign state actors, particularly from 
Russia and China,” according to Dr, 
Phil Howard of the Oxford Internet 
Institute. “In fact, 92 percent of the 
misinformation from state-backed 
agencies around the world originates 
from Russia and China.” 


—From CBC News article “COVID-19 
disinformation being spread by Russia, 
China, say experts." msn.com/en- 
ca/news/world/covid-19-disinformation- 
being-spread-by-russia-china-say- 
experts/ar-BB14B35i 
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While the Kremiin’s disinformation campaigns may appear focused on creating chaos for the 
United States and otner Western countries, tne reality is that it hopes to utilize disinformation 


to weaken perceived adversaries in order ta achieve strategic goals. including restering 
Russia to great power status. preserving its sphere of influence, protecting the Putin regime, 
and enhancing its military effectiveness.** 


The Kremlin’s disinformation methods 


Kremlin-supported propaganda, disinformation, and information manipulation primarily relies 
on its advancec network to spread easy-to-uncerstand messages thal exemplify a clear 
narrative of the United States as the aggressor and Russia as the enly cauntry brave enough 
to stand up to U.S, hegemony." Russia has been utilizing strategic cisinformation tactics 
since the 1950s to try to influence the perceplicns of people worldwide. The Russian 
government has far years included disinformation and misinformation as part of “active 
measures,” or covert influence operations.” In fact, the word “disinformation” is derived from 
the Russian term dezinformaisiya {nesanpopmauna).®’ Highly coordinated disinformation 
campaigns are meant to influence the perceptions and actions of others and make it highly 
difficu't to discern between the real and the pnony. The goal of these campaigns is to 
weaken perceived Russian adversaries, often by fracturing the bonds of societies in order to 
ry to weaken or cripple alliances in the West, with the goal of uhimately making it possible 
for Russia to outcompete the United States and Europe.** (Note: Itis not just Russia versus 
the United States; Russia also uses disinformation 

against Europe and others, and they usec it 


extensively in Ukraine to try to influence events. Factory of Lies: The Russian 

Y a a SN Playbook is an NBC explainer on 
Since 2015, the Kremlin has begun expanding its now Cold War tactics have 
media influence by creating media cooperation continued to be used by Russia 
agreements with over 50 local media organizations as a way of subverting the media. 


around the world.©& The messages shared through Kesliabiaay haeknlnL ReRPHRL.- 
these networks play on strong emctions and tend te uZau eta: saci 

Go very wel! on social media, where users have 

been shown to interact with content that is emctional 

in nature.”© Thus. in countri¢s where both the United States and Russia have been working 
to develop influence, the Kremlin tends to pul forth narratives that are easy to Understand, 
play to the emotions. and disingenuously offer a clear good quy—bad guy paradigm.”' 
Comparatively, the United States has often struggled to offer effective fact-based 
alternatives to sucn narratives. This is particularly relevant in countries where USAID works 
to promote democratic governance. 


A key example that merits consideration is the massive disinformation campaign lodged 
against tne White Helmets, known as the Syria Civil Defense, during the Syrian civil war.’* 
Russia in panicular used propaganda and cther disinformation tactics to sow seeds of doubt 
aboul the wark of the White Helmets and to undermine their humanitarian mission. As The 
Guardian reported, “The aim was to flood the media ecosystem witn falsehoods that would 
erode trust among supporters. especially donor governments.'’* For another exampie—one 
within Latin America—botn the governments of the United States and Russia are working to 
influence the gecpolitical situation in Venezuela. In order to counter Russia's influence, the 
United States must work to provide an effective allernative narrative, while simultaneously 
being aware of the ways Russia creates coordinated disinformation campaigns and offers a 
rebuttal to negative reporting, Notably, this challenge of countering Kremlin intiuence is also 
felt in Ukraine, Moldova, and Georgia {and other post-Soviet states)—countries that are 
looking to orient their cultures, politics. and economies away from Russia, but face the 
challenges of ongoing Russian state effors to exacerbate polarization and conflict. 
Strategies for these areas, ripe for exploration, are often based on the goals o7 weakening 
the country or destroying its independent, Western, or democratic resolve. 
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Rules of the Russian Playbook 


Russia's strategy for disinformation is a seven-step 
process intended to ultimately fracture societies 
fram the inside. 


1. Look for cracks and social divisions within the 
target society. 


2. Create a big |e. 
Wrap the lie arcund a piece of truth. 


4. Conceal your hand (make tne story seem liKe it 
came from somewnere else}. 


5. Find a useful idiol (whe will take ihe message 
and push it to foreign audience). 


6. Deny everything. 


Play the long aame, resulting in a major 
political impact years from now.”* 


The internet and social media have given the Russian government an immediacy and reach 
that it never had previously to continue spreading disinformation and lies while 
simultaneously slowly tearing away at tne fabric of democracy. 


In August 2020, the Department of State's Glopal Engagement Center published a report 
discussing how Russia utilizes a variety of tactics and channels to create and amplity 
disinformation and propaganda.”? Russia's disinformation and propaganda ecosystem is a 
collection of official, proxy. and unattributed communication channels and platforms 
consisting of five main pillars: official government communications, state-funded global 
messaging, cultivation cl proxy sources. weaponizaticn of socia| media, and cyber-enabdied 
disinformation. [he Kremiin's willingness to employ this approach provides it with perceived 
advantages: 


e |t allows for the introducticn of numerous variations of the same false narratives. This 
allows for the different pillars of the ecosystem to fine-tune their disinfermation narratives 
to suit different target audiences because there is no need for consistency, as there 
would be with attributed government communications. 


e it provides plausible deniability for Kremlin officials wnen proxy sites peddle blatant and 
dangerous disinformation, allowing them to deflect criticism while still introducing 
pernicious information. 


e (|tcreates a media multiplier effect among the different pillars of the ecosystem that boost 
their reach and resonance. 
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The Government of Russia's strategy for dealing with negative reporting on its actions 


revolves around four tactics: 


1. Dismiss the critic. 
2. Distort the facts. 
3, Distract from the main issue. 


4. Dismay the audience.” 


This strategy allows the Kremlin to maintain contro! over 
the information being spread by virtue of discrediting the 
individual or organization sharing tne intormation, 
aistorting information to fit their purpose and to Support 
state interests, distracting from the situation at hand 
where it may be at fault, and launching accusations 
elsewhere and dismaying the audience by warning ihat 
moves that negate state interests will have disastrous 
consequences for those planning them. These 
strategies—along with a reliance on Kremlin-controlled 
media and paid or sympathetic commentators in the 
West—allow ihe Governmem of Russia to spread its 
messages and influence public perceptions around the 
world.“ 


Chinese Communist Party’s Disinformation Methods 


The Chinese Communist Party (CCP) deliberately seeks 
to reshape the current worla order to Beijing's 
advantage. Tne CCP deploys comprehensive, 
coordinated, “whele-of-government’ influence 


Helpful Resource 


“Canary in a Digital Coal Mine,” a 
new documentary irorn the National 
Democratic Instiuie, shows how 
digifa! activism and collaberation 
between the government and its 
citizens in Taiwan has helped 
withstand the threat of 
disinformation, The jim features 
Taiwan's civic tech community, led 
by the organization gOv, which uses 
open data and public tools to fight 
for transparency and democracy. 


Watch at: 


atic. Institute/viceos/6425830062939528/ 


campaigns to promote and maintain Party narratives domestically and glopally.’® 


According to a careful observer, [he CCP’s propaganda apparatus ts a critical component in 
promoting and mainiaining its narralive domestically and globally. Its efforts to use 
censorship, intimidation, coercion, economic incentives, and propaganda to comrol the 
information space are a significant component of its attempts to expand its influence 
worldwide. This approach to information control actively seeks to downplay concerns 
regarding Cnina’s state abuse and Surveillance of Tibetans. Uighurs, and members of otner 


ethnic minorities.” 


CHANGING TACTICS 


There are increasing indications thal Beijing is taking a More aggressive approacn to 
information manipulation similar to Moscow. The COVID-19 pandemic has demonstrated 
that Beijing is increasingly promoting disinformation, pushed out by state media, its officials, 
and CCP-attiliated sacial media accounts, bots, and trolls. Beijing also undertook 
concentrated efforts to push conflicting theories about the pandemic which were intended to 
sow doubt, deflect blame. and create the idea that the PRC is superior to the United States 
in responding to internalional health crises ike COVID-19, Observers saw an increasing 
confluence or convergence of Kremlin, CCP, and Iranian regime false narratives regarding 


EP oe CT ON ee ae | ee Ae ee ee a Ee eee A re . ee > ns eee eh a a. 


AS PIM Mo DEERE SETS GAA OCIS LCE PPMP ey Oil Five VILE |) 
converged to spread anti-U.S. disinformation, especially to include spurious claims that the 
United States caused or exacerbated the COVID-19 pandemic. This convergence appears 
to be a result of “opportunity,” not intentional coordination, bul all three actors are more 
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routinely leveraging the information tools of the others in their campaigns. Also, the Kremlin 
and the CCP share a common agenda in discrediting democracy and advancing non- 
cemocratic governance systems (especially as being more effective in responding to the 
pandemic). 


THE PRC'S “SHARP POWER” METHODS 


The Sharp Power methods are more about the PRC's control over the narrative about China 
than disinformation, per se. They are a small sudset of the CCP’s malign influence toolkit. 
The CCP utilizes ail elements of statecrafl—sucn as ciplomacy, military. propaganda, and 
economic levers, in addition to its United Front Work Department (UFWD) to exert its 
malign influence abroad. The UFWD, a department under the CCP Central Committee, is 
responsible for establishing the narralives around strategic issues, especially those 
concerned with territorial concerns and unification. Major concerns of the UF WD regard 
ethnic minorities issues. The CCP seeks to “shape and contro! information flows. oully 
governments and corporations, infiltrate and corrupt political systems, ana disrupt and 
debase civil instilutions,’ according to [he Hoover Institulion at Stanford University. These 
efforts allow the CCP to contro! domestic and injernational narrat\ves around Beijing and 
shape a positive international perception of the PRC to support CCP narratives.*' These 
methods are primarily used to control the narrative from what tney refer to as the “five 
poisons:” Taiwanese, Uighurs. Tibetans, Falungong, and pro-democratic activists—the five 
groups tnat are most at danger of tarnishing the PRC’s global image.®** Taken collectively, 
Beijing's “sharp power” strategy seeks to employ “covert, coercive, of corrupting” methods to 
shape the international world order in areas favorable to CCP interests. 


Beijing also has the advantage of platforms like TikTok and WeChnat (Chinese-originated 
applications} that are increasingly used all over the world, which have been used as tools to 
contro! and suppress information, especially as it relates ta CCP priorities. In particular, the 
Chinese government blocks information on WeChat and even removes information from 
private chats.® In this way, Beijing controls the narrative about the PRC and maintains a 
positive image as an alternative to a democratic society. While Beijing has seemingly chosen 
to focus on the Chinese diaspora, Chinese mainland, Taiwan, and Hong Kong as places to 
utilize thelr influencing strategy, the CCP is working te perfect this strategy in order to utilize 
it in other contexts abroad to influence public cpinion.” 


Across sub-Saharan Africa, the Beijing-based StarTimes television operator provides a 
popular digital television service. including CCP state propaganda, in the cheapest package 
available but does not offer alternative international media outlets.°° StarTimes Vice 
Chairman Guo Ziqi has stated that their aim is ‘to enable every African household to afford 
digital TV, watch good digital TV, and enjoy the digital life.“ Ultimately, however, this 
highlights China’s strategy of snowcasing a positive image toward tne world and providing 
services to developing countries at scale, albeit through tne lens of the CCP. Beijing 
presents itself as a developing country among equals in the developing world and 
encourages those countries to replicate the CCP's authoritarian governance if they want to 
pursue economic development without democratization.** This view is explicitly intended to 
offer an alternative to U_S. international leadersnip and democratic governance, It is also a 


centra! tenet of Beijing's media strategy. 


The CCP’s investment in media bureaus overseas, conitent-sharing agreements, and the 
distribution of content in multiple languages clearly exemplifies Beijing's strategy to influence 
positive altitudes toward China globally. A 2015 Reuters investigation found that CCP- 
funded programming was available in 14 different countries.*’ By 2018. a Guardian report 
revealed that the number had grown considerably to 58 stations in 35 countries.” 
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PART THREE: HOW DOES DISINFORMATION WORK 
ONLINE? 


The business models at major social media companies such as Facebook, Twitter, and 
Google are built on data-targeted advertising and algorithmically optimized filtering. This 
model is highly advantageous for coordinated inauthentic actors who have the funds to 
achieve their strategic goals. The fact that these social media companies’ business models 
are based on automated algorithmic filtering and targeted advertising means that much of the 
content that is being promoted is targeting similar sects of people. This can lead to malign 
actors targeting people who will be more susceptible to their messages and these people 
then sharing with others in their network, thereby creating an echo chamber around a topic 
with information that.may be false and misleading. 


Photo: ©2020 Unsplash/Brett Jordan 


Disinformation thrives best in digital spaces when dissemination agents can construct an 
effective illusion that changes the behaviors of many authentic users in ways that verify, 
elevate, and amplify false narratives. Behavior change is sought around things like voting 
behavior, physical confrontations, conflict, geopolitical orientation, and disruption of 
democratic deliberation. To better understand the way new technology is used to manipulate 
social media users and disinform the public, it is imperative to understand same key terms in 
this field and that this is an evolving space and new types of manipulation are likely to 
appear. 


While there are a multitude of actors working to spread disinformation around the world, 
research and evidence supports thai state actors, and specifically political candidates and 
natinnal laadore are incroacinaly infilizvina enrial madia niatinrme tn cenraad dicinfarmatian 


ee ea ee tee eS tea ee oe. ee te ‘o.oo ss eee eget ert Pee ee Vey saan a ald _—-_Prae? 


about their opponents, manipulate voters, and ‘shape elections. Although in the past, 
negalive campaigning has been utilized in close races and against opponents, the difference 
now can be seen in the use of artificial intelligence, sophisticated data analytics, and political 
trolls and bots. Information pollution is increasingly used as a too! to encourage skepticism 
and distrust and polarize voting constituencies and undermine the democratic process.* 


The spread of disinformation can occur through manual channels thal require manpower, 
automation, or a combination of both. The Oxford Internet Institute (Oll} published a 2019 
report that finds “growing evidence of computational propaganda around the world.” Oll's 
Propaganda Research Project (COMPROP) investigates the interaction of algorithms, 
automation, and politics. Their work includes analysis of how tools like social media bots are 
used to manipulate public opinion by amplifying or repressing political content, 
disinformation, hate speech, and junk news. COMPROP found evidence of organized social 
media manipulation campaigns in 70 countries, up from 48 countries in 2018 and 28 
countries in 2017. 
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Manipulation Technique Key Terms and Definitions 


Astroturfing: An organized activity that is intended to create a false impression of a 
widespread, spontaneously arising, grassroots movement in support of or in opposition to 
something (such as a political policy) but that is initiated and controlled by a concealed group or 
organization (such as a corporalion), 


Bots: Social media accounts that are operated entirely by computer programs and are designed 
to generate posts and/or engage with content on a particular platform. 


Clickbait: Something (such as a headline) designed to make readers want to click on a 
hyperlink especially when the link leads to content of dubious value or interest.*'’ This tactic 
involves creating a misleading or inaccurate post using a provocative headline or image that 
lures the victim to click and read the content, which is often unrelated or less sensational than 
the headline itself. 


Content Farm: A website or company that creates low-quality content aimed at improving its 
search engine rankings. Also Known as a content mill or factory, its main purpose is to maximize 
pageviews and revenue generated by advertising on those pages while minimizing the costs and 
time needed to create the content.** 


Cyber Troops: Government or political party actors tasked with the use of social media jo 
manipulate public opinion online.” 


Gaslighting: Technique of deception and psychological manipulation practiced by a deceiver, 
or “gaslighter," on victims over an extended period. Its effect is to gradually undermine the 
victims’ confidence in their own ability to distinguish truth from falsehood, right from wrong, or 
reality from appearance, thereby rendering them pathologically dependent on the gaslighter.% 


Manufactured Amplification: Occurs when the reach or spread of information is boosted 
through artificial means. 


Microtargeting: To direct tailored advertisements, political messages, etc., at (people) based 
on detailed information about them (such as what they buy, watch, or respond to on a website): 


to target (small groups of people) for highly specific advertisements or messages.” 


Sock Puppets: A sock puppet is an online account that uses a false identity designed 
specificaily to deceive. Sock puppets are used on social platforms to spread or amplify false 
information to 2a mass audience.” 


Trolling: The act of deliberately posting offensive or inflammatory content to an online 
community with the intent of provoking readers or disrupting conversation. The term “troll” is 
most often used to refer to any person harassing or insulting others online.** 


Troll Farm: A group of individuals engaging in trolling or bot-like promotion of narratives in a 
coordinated fashion.®* 
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This research is important to track as it 


shows the growth in use of computational The Cambridge Analytica (CA) scandal 
propaganda (using algorithms, automation, provides an important case study on the 
and human curation to purposefully relevance of psychographics and how 
distribute misleading information over social they are used and manipulated in 

media networks) and social media disinformation campaigns with 
manipulation by countries, governments. devastating oulcomes for events such as 
corporations, private aclors, civil society, elections. 


and parties." . 
Of interest to the CA story is how 


The Oll research includes a systematic Facebook data could be mined for 
content analysis of news articles on cyber millions of people and then used to 
troop activity: a secondary literature review create psychographic profiles, These 
examined public archives and scientific profiles, in turn, were used for marketing 
reports, country-specific case studies. and and microtargeting campaigns. 
expert consultatians. Of the 70 countries According to reports by NBC, “The idea 
where social media manipulation behind the project was that political 
campaigns occurred in 2079, Oll broke preferences can be predicted by 
down the demographics of global personal details that people voluntarily 
disinformation spread as such: provide on their social media accounts. 
By analyzing the details that users share 
® 87 percent used human accounts. online, CA could predict individual 


behavior, which included voter 
preferences and how to influence thal 
e 11 percent used cyborg {bot + human) preference.” 

accounts. 


e 80 percent used bot accounts. 


For an in-depth !ook at the CA-Facebook 
scandal, watch the documentary The 
Great Hack, which shows how illicit use 


* 7 percent used hacked or stolen 
accounts. 


Oll's report offers cther key findings tnat of personal Gata can be harvested and 
synthesize both demographic and used for malian purposes. 

psychographic data about globa 

disinformation spreaders. Tne findings demonstrate the adaptability of digital disinformation 
campaigns thal can be employed by a variety of players and the prominence of Facebook as 
the platform of choice when engaging in digital manipulation campaigns. 


Gaining a better understanding of the ‘who’ is imperative to all facets of re-establishing 
information integrity within an information ecosystem. Knowledge of these profiles, their 
motives, and favored modes of digital intervention should inform both the information 
diagnostic process and tactical solutions to suppress the circulation of false news. 
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A. HOW ALGORITHMS AMPLIFY DISINFORMATION 


An algorithm, as a sequence of instructions 
telling a computer what to do, is usually gS 

built to collect information, recognize i 
patterns, or reach people with particular if not OS, vath. ex sts. 
profiles. Where they can find out how the 
algorithm works, disinformation agents can 
craft dissemination strategies to piggyback 
on a platform's algorithm. In other words, fine t 1 on to 
players can game the algorithm to gain we pun / +’ 
access to more digital real estate than 
would otherwise be possible through 
simple manpower. 


em 
if(item Event 


if(item Event 
‘ item_Event 


advertisement. Through user data analysis, ie Event =. 
brands can locate specific social media 
orofiles and atidiences whose interests. 


While platform algorithms present users 
with a litany of navigational and 
engagement options, they are generally 
built to elevate and amplify engagement to 
generate profits. Social media platforms 
amass profits through paid, targeted 


beliefs, and social behaviors align with 
their target market audience. 


Posts and threads that garner lots of 

attention and engagement become prime real estate for marketing. Platforms, therefore, are 
financially incentivized to attune algorithms to amplify posts with the most engagement. 
Disinformation narratives. troll attacks, gaslighting, and clickbait can generate outrage, 
opposition, ugly discourse, and/or salacious curiosity that will keep the user’s attention and 
engagement. In this way, computational platform algorithms become accomplices to the 
dissemination of disinformation because the discourse, which undergirds platform profits, is 
effectively programmed to elevate sensational content.'*' 


Noteworthy in understanding the significance of algorithms: these systems shape the 
information environment regardiess of manipulation from disinformation actors. |.¢., 
YouTube's recommendation algorithm or Facebook's Newsfeed make decisions about what 
billions of people see by prioritizing types of content they can limit what you see. The key 
takeaway: bad actors can exploit the algorithm, but without more transparency and 
accountability we can have bad information outcomes even without bad actors.'™ It is also 
worth noting the importance of algorithms and the effect they can have on news outlets’ 
business model and bottom line in a digital economy. In the business model of social media 
platforms’ algorithms prioritizing content that gets the most views and interaction, which 
often prioritizes disinformation and misinformation since they spread more quickly and 
widely. 


B. COORDINATED INAUTHENTIC BEHAVIOR 


Coordinated inauthentic behavior'®? (CIB) is a term coined by Facebook in 2018 to describe 
the operation of running fake accounts and pages on an online social platform to influence 
discourse among users. Facebook releases monthly reports that track CIB on its platform 
and the actions it has taken to address it. As a violation of its community standards, 
Facebook will remove posts deemed to be taking part in CIB.“ For the purpose of this 
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primer, we will be discussing coordinated inauthentic behavior in the context of political 
aciors. 


Advanced technologies, such as artificial intelligence, search engine optimization, and bots 
have allowed for disinformation agents to manipulate iniormation and influence the public 
sphere using cocrdinated inauthentic activity. They contribute to a significantly less free 
internet. where certain voices aré amplified above others because of the resources at their 
disposal and the malicious practices they utilize. Some have called this tactic “censorship by 
noise,” in which artificially amplified narratives and campaigns drown out legitimate dissent. 


In particular, coordinated inauthentic actors have been able io utilize online systems to their 
advantage by using algorithms. Algorithms offer a unique epportunily for actors to coordinate 
messages because many tires, the users ihey hope to influence reside in a filter bubble of 
content with other users who share similar beliefs and ideals. In turn, these filter bubbles 
allow content that may otherwise be flagged as inauthentic or false to pass by undetected, 
As Dipayan Ghosh and Ben Scott argue, targeting and using these algorithms is not an 
abuse of tne platforms as they were designed to markel and sel! tc us: nowever, the 
unintended consequences can undermine democracy and snread disinformation |‘ 


C. HOW DISINFORMATION SPREADS ACROSS ONLINE PLATFORMS/APPLICATIONS 


Disinformation agents have a variety of advantages when utilizing the internet and socia’ 
media platforms to share content. Strategies used to mask the criginator include the 
placement, layering, and integration of media messages; this makes it difficull for fact- 
checking organizations to trace the source of the disinformation. Disinformation agents often 
obscure their efforts in order to dust off their fingerprints and in doing so work through 
proxies, While finding the origin of the information is possible, it requires a level of 
investigative journalism to track it down beyond the capacity of mest users and journalists. 
Additionally, tech companies’ advertising models, which are primarily focused on maximizing 
profit, contribute to the spread. Finally. the organic information ecosystem also makes it 
easier tor information to spread, and tne message to be amplitied. In sum, the cumulative 
effective of disinformation nas varying degrees of impact, ranging from little to no effect to 
causing severe harm. 


The "breakout scale" (Figure 5) provides useful indicaters of the growth of disinformation 
across online platforms, Each of its six categories demonsirates a growing impact as content 
travels across multiple platforms (even including offline media and policy debates) and 
whether it will remain isolated to a few communities or spread through many communities 
and become a larger or even global phenomenon.’ The importance of the work by Nimmo 
and others seeking to map, measure, and understand the disinformation effect on scciety is 
thal there's an urgent need to put in place preventative measures. including undertaking 
research studies and engaging in ongoing media monitoring in order to be prepared for the 
amplification of disinformation that can lead to chaos or worse. 


USAID.GOV DISINFORMATION PRIMER | 25 


FL-2023-00013  A-00000748592 "UNCLASSIFIED" 2/27/2024 Page 35 


FOR INTERNAL USE ONLY 


Figure 6: Ben Nimmo’s, Breakout Scale: Measuring the impact of influence operations 


THE BREAKOUT SCALE 


ODM AYE 


CATEGORY ONE CATEGORY Two CATEGORY THREE GATEOORY FIVE CATEGORY SIX 
ew plationn, no breaiout one platforn, bewsleou! OR rug tiple platforms, crost-nedaum begakout celebrity sripification policy response OR 
many pattem. no rraaltiple breakouts cal for vielence 


Source: hitos.//www.brookings.edu/researctythe-breakoul-scale-measuring-the-impact-of-influence-operations/ 


DISINFORMATION SPREAD ON SOCIAL MEDIA PLATFORMS '”” 


In a few decades, the online media industry has grown from a new frontier with privileged 
access for tech-savvy groups and individuals to one that supports the most profitable and 
growing industries. The internet provides a unique advantage for malign actors to spread 
false content and let it organically amplify as it spreads across platforms. Some conspiracy 
theories and false claims originate on niche platforms such as conspiracy forums on 4chan 
or Discord or gaming platforms like Twitch. Platforms such as these enable users to 
coordinate to grow followers and spread content to large social media sites such as 
Facebook and Twitter.'°* 


In this way, platforms that cater to very niche and smal! audiences have significant influence. 
A post shared from one of these original sites can cross to intermediate sites such as 
Twitter, direct-messaging groups, and Reddit, where they gain traction and are then be 
amplified further on massive social media platiorms such as YouTube or Facebook. 
Journalists, politicians, and influencers find the content and push it on to even larger 
audiences, This content now becomes part of the public record and credible news outlets 
often feel obliged to cover or debunk it, providing it with even more traction. In this way, 
disinformation goes viral, self-propagating itself from fringe groups to major news outlets. As 
disinformation takes over, it is an enormous challenge to halt its momentum or inoculate 
people against it. 


The rise of big data analytics, “black box” algorithms (an invisible process through which 
machines learn about social patterns}, and computational propaganda (use of algorithms, 
automation, and human curation to purposefully distribute misleading information over social 
media networks) have raised concerns from policymakers. The social media business model 
thal includes advertising and data sales promotes controversial posts and information (even 
though Facebook and YouTube have worked on addressing this lately). These promotion 
tools have been used in many countries to expand the reach of divisive social media 
campaigns, to intensify political conflict, and to weaken public trust in the media, democratic 
institutions, and electoral outcomes. The threats to democracy are further intensified by 
microtargeting of messages to specific users through sophisticated and proprietary 
algorithms. 
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As Foreign Policy arqued in an articie’s headline: Disinformation Is Drowning Democracy: 


"In the new age of lies, law, nct tech, is the answer, From India to Indonesia te Brazil. 
democracy is being compromised by on|ine domestic disinformation campaigns trom 

political parties seeking to gain an advantage. Democratic institutions nave not been 

able to keep up and have instead deferred to tech firms, trusting them to referee 


Ps) eS hes et, Len, e's bee: 2 e -  d ce * B k e | Be en  2e  d * Sel eT te Oh et ed | Kee ae ee LE ce | Ok ts ee. ee ek hae 
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motivations of companies such as Facebook and Twitter. If the democralic recession 
is lo end. democratic institutians need io create new rules and hold the responsible 
parties to account.'"* “ 


DISINFORMATION SPREAD ON CHAT APPLICATIONS 


It is also important to recognize the role that chat applications sucn as Facebook Messenger, 
WhatsApo, Signal, and Telegram play in tne spread of online disinformation. Particularly in 
countries in Africa and the Middle East and the Global South as a whole, chat applications 
are an important medium being used to disseminate key political information, activity 
coordination, and a platform for sharing news and current events. Additionally, many of 
these chat applications in the Global Scuth host large groups in which entire cormmunities 
can participate. A 2018 Oxtord report on computational propaganda found evidence of social 
media manipulation campaigns occurring on chat platforms in about a fifth of the countries 
that were surveyed; many of the countries were from the Global South. ''” 


Chat applications are closed - metrics and data about how they work are not accessible. 
They are therefore hard for researchers to study and difficult for companies to moderate. 
The applications use end-to-end encryption and offer users security and privacy. Growing in 
usage globally. these applications have the potemia! to spread messages to rather large 
groups. Because of this, some nave been limiting the size of groups wih whom you can 
share to address large-scale dissemination of mis/disinformation. Another response to slow 
the viral soread of mis/disintormation on closed messaging platforms has oeen io limit the 
number of times a user can share messages. More on WhatsApp and closed messaging 
systems is found above in the section en Context and Secia! Factors of Disinformation 
(page 12). 


D. TROLL FARMS AND SOCK PUPPETS: CASE STUDY FROM THE PHILIPPINES 


A case study that illustrates many of these tactics is the current state of information diserder 
in the Philippines. widely considered to be patient zero of the cisinformation tactics that are 
now used glovally.''' Because Facebook ts tne internet in the Philippines, content farms, 
troll farms, and sock puppels have been effective in both the spread of disinformation and 
the suppression of opposition voices. 


Troll Farm: A clear examole of a troll farm is Filipino President Rodrigo Duterte's 
propagated use of trolls to target and defame politica! oppenent and vocal critic Leila de 
Lima. After pornographic images went viral in 2076, in which de Lima was falsely attributed 
as the woman pictured, troll farms coordinated by the Duierte election campaign pushed the 
false narrative within Facebook communities,''* Trolls used the false content to shame her, 
attrioute her to other scandals, and attack de Lima’s character in efforts to delegitimize her 
as @ viadle oclitical candidate in the then-upsoming election.''* Though the video was 
ultimately exposed as false, de Lima's reputation was stained, and she was arrested on drug 
charges, which sne denies, six months iater.'” Since her detainment, critics have pointed to 
trolls’ spreading of conspiracy theories and misinformation on Facebook to helping lead to 
her arrest, as we!l as to distort the public's understanding cf the national issue of drugs and 
further damage the country’s democratic processes !!° 
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Sark Pimnet: The niiblicatinn Rannier 


ee nD ee ee ee ee ee re ee 
investigated suspicious accounts 
linked to online Facebook groups and 
came across “Mutya Bautista,” a 
supposed software analyst al a 
Filipino broadcast network using a 
Korean pop star's picture for their 
profile. Although “Bautista” has only 21 
Facebook friends, they are connected 
to over 160 groups, each with tens of 
thousands of members. In these 
groups, the persona and other sock 
puppet accounts chime into political 
discussions with real users, repeal 
false narratives, post politically 
motivated family anecdotes, and link to 
false news stories in comments.'"® 
Sock puppets such as “Mutya 
Bautista” can be used to support the 
illusion that false narratives are 
believed by regular citizens or to 
drown out those voicing opposition to 
the falsities in attempts to sway 
opinion on the perceived power and 
support behind their position 
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lv. PART FOUR: WHAT SOCIAL FACTORS CONTRIBUTE TO 
DISINFORMATION ? 


This part explores the social dimension of disinformation, drawing from the latest 
psychological and sociological research, to consider why we are so susceptible, as humans, 
to disinformation. It is essential to understand why humans are susceptible to misinformation 
and disinformation and who is vulnerable. People not only consume disinformation; they call 
for it themselves, demanding content that they think serves a purpose in their lives, whether it 
is true or not or in their own interest. How do we understand the factors that drive this 
consumption of disinformation (the demand side) and make it more likely to be accepted and 
actionable? And what do we need to know about the social factors promoting the production 
of disinformation (the supply side)? 


Photo: ©2020 Unsplash/Mike Sroll 


A. CONSUMPTION OF DISINFORMATION (THE DEMAND SIDE) 


A useful—alihough imprecise—distinclion about the drivers of disinformation is that they can 
be passive or active. Passive drivers are largely subconscious; they require no conscious 
motivation for individuals to seek out and consume false claims. For example, a person may 
share information without even reading if it comes from a trusted family member or friend 
ithis is called “familiarity effect” see Annex 4: Passive & Active Drivers Of Disinformation). 
On the other hand, active drivers are informed by an individual's thought processes and 
efforis to understand ideas and reach conclusions through cognitive processes.''® In this 
way, a person may believe information that contirms or contorms to a deeply held conviction 
(contirmation bias).''° 


Some passive and active drivers of disinformation and the reasons disinformation can be 
psychologically difficult to discern are described below 


1. Passive drivers of disinformation 


In general, people are great passive consumers of information that is passed on to them. 
This tendency is amplified online and can result in many individuals reading and reacting to 
often emotionally provocative content. Coordinated inauthentic actors rely on this emotional 
content, to reinforce or encourage people to act. In evaluating what factors lead to accepting 
information without taking the time to critically engage with it, Woolley and Josett provide a 
useful list of cognitive drivers (see Annex 4, Passive and Active Drivers of Disinformation, for 
more detailed definitions of passive drivers of disinformation) that make it difficult for an 
individual to discern between truth and falsity and, in turn, make it easier to manipulate them 
into believing false content. 
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For example, online conteni, such as pictures of people in distress. can prime individuals 
(“priming’} by reinforcing existing subconscious biases, thus shaping their perceptions or 
behaviors, Or by the repetition of a claim (‘repeat exposure") many times over, a claim that 
was clearly false on first reading may be taken as more vajlid than it is. “Truth biases” such 
as the tendency to believe printed or online claims on their face may generally serve us well; 
in the digital sphere, however, they alsc open us up to even absurd claims. 


People tend to overestimate the depth cf their knowledge regarding topics they care aboul. 
This provides them wiih an illusion of truth or exolanatory depth in the information presented 
to which they are exposed'*" and may reinforce their beliefs. This “belief perseverance” may 
be helpful to explain why individuals often remain staunch in their beliefs even after reading 
contradictory claims, When individuals are asked to think critically about their beliefs and 
shown information that contradicts them, they often maintain that their beliefs are still 
correct. Such perseverance of beliefs even when they have been debunked by fact-checking 
has been thought to create a “backfire effect” in which beliefs are reinforced by the attempt 
to debunk them. However. some current research suggests that debunking efforts may work 
well if the facts are relatively unambigucus. *' 


2. Active drivers of disinformation 


Active drivers are distinguished by the conscious pursuit of fact claims that serve the 
purpose of the information consumer. Woolley and Jceseff's list illustrates some of the 
reasons that drive people to seex out false information. (See Annex 4. Passive and Active 
Drivers for Disinformation, for more detailed definitions of passive drivers of disinformation.) 


A common driver is “directionally motivated reasoning” in whicn people actively consume 
disinformation to reinforce a specific conclusion they want to reach for political, ideological 
reasons or in order to reinforce their preexisting opinions (see also ‘confirmation bias” and 
“prior attitude effect’).'°* 


Even it an individual knows that information is false, she or he may be driven to believe it 
anyway. This often relates to societal pressures that may influence which beliefs individuals 
publicly adhere to. 


An individual might think it is important to believe even dangerous ideas if they are important 
to a group in which she or he belongs ("bandwagon effect"). Similar to this phenomenon is 
“consensus bias,” in which an individual may believe false claims because of the perception 
thal everybody else believes them and “in-group favoritism’ in which specific group identities 
are at stake. 


Often. active consumption of disinformation may require a person to ignore contradictory 
beliefs or knowledge of facts. This effect, “preference falsification,” cccurs when individuals 
suppress their true opinion in favor of societal pressure to support another preference. '= 


The rapid spread of and demand for disinformation may be altribuled to laziness or lack of 
capacily to exercise critical thinking wnen consuming information. Gordon 

Pennycook and David Rand. psychologists who have studied and research psychological 
demand for disiniormation, examined ihe extent to which participants were able to think 
critically about disinformation in a series of cognitive tests. Tney snowed panicipants true 
and false headlines taken from social media from diverse sides of the political spectrum. The 
recite aft +Ae «tidy achawoeod that naricinante whn an tre firat tect had chawn nroftearance ine 


ie ae.) ~~ |. oF = a tetas wes eS ee ee, eee | ed a 7 ee eS ee eee ee ee, PS a Ae 8. eae re ee Tw See? TSS. '.? 


utilizing their cognitive reflection did better at discerning the true headlines from the false no 
matter their political affiliations. '*" 
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B. PRODUCTION OF DISINFORMATION (THE SUPPLY SIDE) 


Anyone with a keyooarc can produce disinformation (the supply side} in the form of posts on 
social media or on the profusion of “news” sites catering to every laste, Disinformation is 
produced by governments, companies, ana individuals to purposefully manipulate public 


perception and political events. 


On social media, fact-checking services are still-developing rules and algorithms are starting 
lo serulinize this information supply. But even while itis possible to iake down or remove the 
worst posts, for every post taken down multiple mutations of the original disinformation will 
take their place. Twitter received 27,500 \egal requests to remove tweets from July to 
December 2019 from 98.000 accounts due to suspicious activity.'** However, this cut-off of 
supply can have a strangling effect on free expression: as Twiiter notes. 193 accounts 
subject to lega| action by governments were of verified journalisis and news outlets, and 
much of the removed information continues to circulate in some form of reiweets. 


Outrage over “fake news” is overwhelmingly targeted at the creators and aistributors of 
misinformation. That is understandable since they are responsible for releasing half-truths 
and outright falsehoods inte the wild. However, there are indubitably as many drivers or 
reasons for producing disinformation as there are human interests—albeii political 
Cestabilization. ideclogy, hate, illegal activity, theft, and other criminal aclivity are age-old 
motivators. Many observers stress that the supply of disinformation will always be an issue, 
but we must really focus on the demand side as much as possible.'*® 


On the other hand, mesi suppliers of 
disinformation are not criminal elements and the 
ability to understand the motive and the capacity 
of the supplier to discern the truth are a 
significant component of digital media literacy. As 
Pennycook and Rand point out, “Analytic thinking 
ig used to assess the plausibility of headlines. 
regardless of whether the stories are consistent 
or inconsistent with one’s political ideology.” '* 
Memes are an important delivery mechanism for 
producers of disinformation, The disinformation 
narrative is often couched in the torm of memes 
(an idea that propagates rapidly). The term is 
now used most frequently to describe captioned 
photos or GIFs that spread online; the most 
effective are humerous or crilical of society. 
Memes can be fun to share, bul researchers note 
they also can be dangerous and are a common 
means through which disinformation, 
misinformation, and malinformation is spread.'*” 
They are considered effective because they are 


Meme Warfare: Design in the Age 
of Disinformation 


The internet dream has become a 
nightmare as the information we 
share is increasingly false and 
misleading, often with tragic real- 
world consequences. This viaeo 
features designer and illustrator 
Dan Stiles, wnose clients range 
from Arctic Monkeys and Tom Petty 
to McDonalds and Google, as he 
examines our role as creatives 
tasked with creating. collecting, and 
disseminating intormation in this 
radically alterea media environment 
and what we can do to help restore 
order, 

Source: 
hitps./‘www.adobe.com/max/2020/sess 
ions/meme-warfare-desinn-in-the-aae- 


caiCny. hey go viral or Nave ine tenagency to 
spread fast, and they can be shared widely to a 
large group of followers with relative ease.'"” 


Or disinformation 0d6303. him 


C. EXPOSING DISINFORMATION 


When we have evidence of disinformation messages and hate speech and believe they are 
spreading rapidly, how ao we monitor and find out through appropriate research how and 
how broadly they are circulating? Digital forensics and network analyses as well as 
traditional media monitoring have emerged as some of the best approaches to track the flow 
cf disinformation. Exposing disinformation is often the first step in countering ft. 
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Social network analysis 


Social network analysis is a usefu! research methed both as a diagnostic tool and as a 
means to develop a strategy for countering and preventing disinformation. Exposing 
disinformation is really the first thing you need ia do. It is tne first intervention that must 
happen and this research can provide an evidence basse to inform program design. The 
analysis of social networks and their role in diffusing new ideas or deepening belief in 
existing ideas has been advancing rapidly in the last decades. Detailing types of 
relationships, gaps. and strongly interconnected communities nelp to understand seth the 
capacity of false information to propagate and the difficulty in correcting it in isolated 
communities. 


Social network “diffusion models” developed originally for epidemiological purposes to track 
the spread of disease are used regularly to provide graphic maps and algorithms tracking 
the spread of disinformation. The diffusion model in Figure 6 (oelow) shows how a network 
ot social media, individuals, and domains enabled the spread of a Kremlin-orchesirated 
cisinformation campaign in Ukrainian elections.'*' Diffusion models have been particularly 
helpful in understanding the reach and impact of social media platforms such as Facebook 
and Twitter to trace the sources of information through social media posts and reposts. 
Social network analysis is a usefu) research methed both as a diagnostic tool and to develop 
a strategy tor countering and preventing disinformation. 


Figure 7: Valerij Zaborovskij’s diffusion model 


Zaborovskij QOFRLab UA-56206377 


Valeriy 


Telegram:Zabar i986 


: block-ru.com 
Social Medias and Contact Details a 
Zabsrovski) Valerij 


on temaidan.su 
Derain Narnes zabar@listru 
Twitter; Zahbarl 956 
Conuws: Zabay 1936 
Google Analytics |D 


antimaidan.rcu 
block-su.su 
UA-GO7Z7974 


IP Address 


UA~ 156932624 reporter com37440.199,155 


Persona 


open-reperterre 
HTM MAR AN XD 


A network is a complex system of actors—called “nedes” in graphic representation—eacn 
connected by a series of relationships. Information as well as resources can pass between 
nodes that have established some relationship. A relationship need not be a deep one. In 
fact, distant relationships. sometimes with people wnem we have never even met, can open 
access io new ways of thinking or to resources that are otherwise out ef our reach.'** Ina 
network graph, the weight er strength of the relationship. the direction of the relationship and 
the degree or distance of people connected by multiple relationships all can tell us 
something about how rapidly and effectively a piece of information will pass from ane person 
to many. 
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The graphs in Figure 7 and 8 shows how a network formed around attempts to influence 
international perceptions on pro-indonesia disinformation about the separations movement 
in West Papua. As Benjamin Strick shared in a blog post, “The campaign, fueled by a 
network of bot accounts on Twitter, expanded to Instagram, Facebook and YouTube. The 
content spread in tweets using specific hashtags such as #FreeWestPapua. 
#\WestPapuaGenocide, #WestPapua and #fwpc.”' The full SNA graph produced by Strick 
can seem daunting (see below); however, it contains important information. li we zoom in on 
a section, for example, the graph reveals central nodes—actors who are important to 
disseminating information widely. Knowing this can improve the focus of countering 
disinformation programming and help to cut off disinformation flows. 


Figure 8: Full SNA on disinformation Figure 9: Zoomed in SNA for Papua, 
in West Papua showing central nodes 
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Another social network analysis, conducted by Graphika, linked inauthentic coordinated 
behavior to influence the 2020 elections in Myanmar to the military who displaced civilian 
leadership in a coup in January 2021. The analysis tracked numbers of posts, numbers of 
ehared oosts. and even the time of dav in which nosts were shared to reveal the 


coordination.'** Facebook removed over 70 accounts. According to Graphika’s report that 

details the social network analysis research: 
As it announced the takedown, Facebook said, “We identified clusters of connected 
activity that relied on a combination of fake, duplicate and authentic accounts to post 
content, evade enforcement and removal, manage Pages and drive people to off- 
platform websites including military-controlled media domains. These accounts often 
used stock female profile photos and photos of celebrities and social-media 
influencers. ... We began our investigation after reviewing local public reporting 
about some elements of this activity. Although the people behind this activity 
attempted to conceal their identities and coordination, our investigation found links to 
members of the Myanmar military.""°° 


Digital forensics 


Digital forensics take a deep look al the data about posts (¢.g., number of shared posts). 
Two of the most-followed fake accounts removed by Facebook this year were focused on 
Philippine news, according to network analysis firm Graphika. Digital forensics found that 
these networks originated from individuals in China; Facebook has also shut down another 
account with links to Philippine military and police. 
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Figure 9: Forensics on the spread of fake coronavirus information by fringe parties in 
South Africa 
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Figure 9 uses digital metrics to quantify the spread of disinformation about coronavirus by 
South African fringe parties, showing how significant a role Facebook played. Forensics 
such as these are very helpful in identifying both where and how people are engaged in the 
digital media ecosystem.'*’ 


The Atlantic Council's Digital Forensics 

Research Lab (DFRLab) publishes research Data Analytics for Social Media 

along these lines. Looking at how Facebook Monitoring: NDI Guidance on Social 
identified and removed disinformation posts Media Monitoring and Analysis 
associated with the United Russia party, the Techniques, Tools and 

research considers the wide scope of data Methodologies is 2 guide to help 

that can be gathered from likes to followers researchers. election observers 

and the types of online activity carried out by technologists and others understand the 
suspicious accounts. A look al how these best practices tools, and 

digital networke are connected nrovides iis pane” eb Martek nl Dae 
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with a map that can inform policy that would 
target the most central players. as 
represented by the larger circles, representing 
domains, social media accounts, 
implementing partner addresses, personas, 
and Google analytics IDs. Based on this 
network map, for example, one might expect 
that a counter-campaign would target and 
watch for information passing by these 
means. Facebook, for example, removed 40 
specific user accounts, 17 pages, one group, 
and six Instagram accounts for coordinated 
inauthentic behavior.' Digital forensics 
(often available as open-source software) 
provide available data on the backend of 
internet use—unique users, page clicks, and 
visits, for example—as critical clues about the 
spread and origins of mis/disinformation. The 
approach can help supply data needed for 
Social Network Analysis (SNA for short) in the 


eee ge ee” eet ty een Von ee oe eae. 
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observation and monitoring for social 
media networks. It presents an 
introduction to the relevant concepts 
when studying these issues, as well as 
a review of how to build a complete 
picture of the socio-technical context in 
a country or region, including the local 
parties’ online presence, social media 
and internet penetration rates, local 
media, ethnic and religious divisions, 
and a host of other factors that manifest 
in the online space. 


Available at: 
%20Media%20Monitoring%20Guide*%s20ADJUS 
TED%20COVER. pdf 


digital realm and quantitative information on the reach of websites or other platforms that are 
needed to inform counter disinformation programming. 


The National Democratic Institute has developed robust data collection guidelines to help 
researchers, election observers, media programs, and others to compile and collect 
meaningful digital forensics and improve media monitoring efforts.'*° 
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Media monitoring 


While digital forensics focus more on the means and sources of disinformation, media 
monitoring efforts highlight content issues to understand the impacts and way in which 
untrue narratives are being constructed. Methods can include social mecia monitoring, 
message monitoring, social |istening, and more traditional coment analysis. All these 
methods consider the actual words and meanings used to coristruct disinformation. 


Social media monitoring is the process of identifying and determining what is being said 
about an issue. individual. or group through different social and online channels. It is also 
used by businesses to protect and ennance tne reputation of their brands and products. The 
method uses bots to crawl the internet and index messages based on a set of keywords and 


phrases.'*"” 


Message monitoring analyzes the tropes, narratives or specific messages that a bad actor 
is putting forward. In this way, i monitors platforms to look at what are the key messages 
that extremist or conspiracy groups are putting out to see if there are specific messages that 
they are repeating in talking points. This is a way to understand how individuals are recruited 
by groups like Al Snabab in Somalia, in order to counter their influence. In long-term 
programs, such as democracy building or civil society strengthening, it is helpful to lock al 
sources of disinformation and monitor the messages over time. 


Social media listenina is A means of attainina internersonal information and social 


intelligence from social media to understand how relationships are formed and influence the 
way we listen to and communicate with one another.'*' Fact-checkers can use social 
listening to develop a more comprehensive understanding of disiniormation consumption 
and groups that might find value in receiving fact-checked anicles, Social media listening 
toals often measure positive, negative, or neutral sentiment. Listening takes perceptions and 
emotions inlo account and nas been an area of growth among corporations as a way of 
improving their marketing. Surveys and interviews as well as coding messages for emotional 
content are ways to listen in on how messages are moving individua's. This can be 
particularly powerful in campaigns against disinformation because it enables reacting in real 
time to would-be consumers of disinformation. as well as addressing the issues that make 
them susceptible to it. 


Natural language processing (NLP) is the relationship between computers and human 
language content. It refers io speech analysis in both audible speech, as well as text of a 
language. NLP systems capture meaning trom an input o7 words (sentences, paragraphs. 
pages, etc.). In this way, NLP proponents are working toward a greater capacity of 
computers to detect fake or fabricated messages that are often couched as satire or hidden 
within unrelated topics. 


For more information. see the Media Monitoring section of Annex 5: Section-by-Section 
Resources. 


Open-Source Intelligence (OSINT) is another strategy utilized for identifying and debunking 
aisinformation. This refers to the multi-method approach of collecting and analyzing free. 
publicly available information and cross referencing it against other public sources, '*“ 
Publicly available information eften includes material from satellite images, social media 
posts, YouTube videos, and online databases, among other sources. “* OSINT is noted for 
its accessibilty as a free tool that anyone can use. 


For more examples, see tne OSINT section of Annex 6: Section-by-Section Resources. 
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V. PART FIVE: WHAT ARE SOME ANTICIPATED 
CHALLENGES? 


Today's digital communications and media landscape is complex and has given rise to a new 
at of cha nes and j amor mport. Acro AID nroarammi 
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countries, this requires a solid understanding of information disorder and robust approaches 
for countering and preventing it. Note: you will want to make your work as context specific as 
possible and commission or fund original. diagnostic research to determine the best course 
of action for your countering and preventing disinformation strategies. 


Photo: 22017 Unsplash/Bank Phrom 


Looking forward, combatting disinformation will remain a serious challenge for societies 
around the world and a danger to democratic governance. As technology continues to 
outpace the development of solutions, disinformation tactics will adapt and innovate to 
remain effective. These inevitable cycles of new disinformation techniques and solutions that 
provide temporary patches are evolving and becoming more sophisticated in the global 
competition over the control of information. 


Future action should concentrate more on critical research and the expansion of knowledge 
on technology innovation, programming, and information systems. There remains ample 
opportunity to explore and develop more tech-based tools and approaches. However, to best 
address disinformation, action and research cannot be left to technology experts alone: the 
general public and civil society organizations need to gain a basic understanding and grasp 
of digital and information literacy. 


The following sections present a sample of trending disinformation tactics. rising threats, and 
potential opportunities. As technology continues to innovate and learn from its previous 
shortcomings, new evolutions of tools and tactics present concern for future information 
aisorder. From the expansion of artificial intelligence capabilities to the exploitation of 
existing vulnerabilities, anti-disinformation approaches will face new challenges from varying 
angles. 


A. EXPLOITATION OF AREAS OF DECLINING MEDIA COVERAGE 


The changing media landscape, from the closure of newsrooms and print newspapers to the 
rise of digital media consumption, has led to the emergence of news deserts: areas in which 
residents have limited access to news and information outlets.'** News deserts can include 
areas where news is unavailable in minority languages, areas in conflict, and areas with a 
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high degree of state control. The problem of news 
deserts is a familiar problem in international 
development: addressing the lack of access to 
news in the Global South is the focus of the 
media development sector. 


Research from the University of North Carolina 
found that news deserts tend to occur in 
communities that are much poorer, less 
educated, and older. '*° In a period marked by 
disinformation and misintormation. the rise of 


news deserts positions already-vulnerable 
populations in an even more disadvantageous 
situation, cutting them off from critical access to 
education, health, safety, and political 
information, among other topics. It also has a 
negative effect on local governance—the 
management of budgets, elections, and local 
problem-solving, for example. 


’ 
Although local newspapers have tried to transition I 
to digital operations, the rise of Big Tech has 
inhibited their success. With Facebook and 
Google sharing 80 percent of the digital ad 
market, smaller organizations are left competing 
amongst themselves for the remainder of the market, limiting the amount of ad revenue they 
can generate.'** Steve Cavendish explains that “print dollars that many news chains have 
walked away from have been replaced by digital dimes or even digital pennies.” leaving 
them to scale back or close. Ultimately, the rise in news deserts may result in more people 
turning to social media as their primary sources for news and information. While social 
media platforms may be widely accessible, they continue to be channels for disinformation, 
misinformation, and malinformation to spread. These platforms are not a replacement for the 
institution of a democratic, free media. 


Consequently, disinformation actors exploit local news deserts, which has led to a new and 
growing phenomenon called “pink slime journalism,”"*’ a low-cost way of distributing 
thousands of algorithmically generated news stories, often with political bias. Designed to 
look like real, local news sites, they are in fact low-cost, automated sites that often push 
partisan agendas. These pink slime sites capitalize on news deserts left when regiona! 
newspapers go broke. While these stories can be factual, they are not based on 
investigation and may parrot fake claims made in news releases or from opinion leaders. 
Increasingly pink slime operations are funded by political parties in the United States or by 
foreign governments (e.g., Iran), highlighting a critical need for transparency. 


Pink slime propagators own multiple newsletters and outlets, which enables them to be 
profitable and makes the niche media essentially a pay-to-play proposition akin to 
advertising, '“* Because of its diversion from critical analysis, pink slime journalism is an 
effective megaphone for disinformation. 


B. UNDERSTANDING ALTERNATIVE MEDIA SPACES 


Discussions on disinformation and misinformation often revolve around assumptions of state 
actors driving the issue. However, problematic information more regularly originates from 
networks of alternative sites and anonymous individuals who have created their own “alt- 
media” online spaces.’*® These alternative spaces include message board and digital 
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distribution platforms (e.g., Redditt, 4chan, or Discerd): conspiracy news sites fe.q.. RT and 
21" Century Wire}; and gaming sites. According to Eliot Higgins, founder of Bellingcat. the 
alternative media ecosystem has become a prominent driver of disintormation, yet not many 
organizations, journalists. or researchers are engaged in this topic. '“ This present failure to 
address alternative mecia systems threatens and undermines other efforts to counter 


disinformation.'?’ 


While information on alternative systems such as conspiracy theories may seem farcical or 
preposterous to an outsider. to users these spaces enable them to collaborate and validaie 
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their own claims and interpretations of the world that differ from “mainstream” sources. '%? 
With this. individuals contribute their own “research” to the larger discussion, collectively 
reviewing and validating each other to create a populist expertise that justifies, shapes, and 
supports their alternative beliefs.’°? As these discussions become larger, “mainstream” 
institutions may pick up on the issue but because ihey do not understand the platform or 
alternative media system more generally. they may unknowingly provide wide coverage of 


misleading information. 


C. “NARRATIVE CONTROL” BY STATE ACTORS 


Authoritarian and hybrid regimes tend to clamp down on dissenting voices while more 
Gemocratic regimes strugg'e to find the best balance in the effort to control the narraiive, 
often justifying these actions as a way of adaressing mis/disintormation. The use of 
legislation and policy, as we! as internet shutdowns are discussed below. 


1. liberal legislation and policy 


Trends in legislative action around information disorder issues suggest many governments 
are under the impression that disinformation can be “legislated away.” However, countries 
who have chosen this route have met many obstacles and criticisms along the way. Outcries 
around censorship or the broadening of executive powers haunt many governments who 
attempt to regulate citizen behavior in digital spaces. 


In Nigeria, for example, after disinfarmation 
campaigns rattled the country’s 2019 
elections, the Nigerian senate look up a 
“social media bill’ to criminalize tne posting of 
false content on social media if the content is 
ceemed to destabilize public trust in the 
government. attempt to influence elections, or 
compromise national security.'** Critics say 
the bill will jaepardize digital freedoms of 
expression while granting the government 
sweeping, unchecked authority over the 
country’s media environment. 


Nigeria’s socia! media bill is almost identical 
to Singapore's Protection from Online 
Falsenoods and Manipulation Bill [(POFMA). 
The October 2019 legislation established a 
nine-member committee to preside over tne 
prohibition of posting politically motivated 
false statements and the creation of 
inauthentic online acccunts (bots or sock 
puppet accounts) within digital plattorms. The 
committee can charge individuals or entire 
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Case study: Nicaragua 


Nicaragua passed legislation in 
October 2020 that will criminalize 
spreading “fake news" on socia| media. 
The Nicaraguan example nas sounded 
the alarm bells for press freedom 
advocates. Given the political nature 
and imprecise nature of the term “fake 
news,” such a law would be difficult to 
apply fairly and is likely to be used to 
increase political repression. Rights 
groups believe the law is a specific 
attempt to silence them. 


Source: Lopez, |. (2020, October 27), Nicaragua 
passes bil! craninatizing what government 
CONSIAGrS fake news. Nat onal Seng ee 

h 


omn/nicaragua- passes- “bil: craninalizing: Mie 
overnment-considers-fake-news 
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media outieis if content is deemed false er misleading or if implemeniaiicn cf the law serves 
greater oublic interest.’ 


Both the Nigerian and Singaporean laws are subjective in nature in that they rely on an 
interpretation of a user's digital actions and intent. Some critics arque this is impossible to 
concretely access. Likewise, the gray area of intent can become an easy decoy for 
governments trying to exercise censorsnip under the guise of law. The constant swarm of 
controversy surrounding many such bills often causes them to slow and Stall in legislative 
processes.'*° 


Taking disinformation legislation a step jurther, the Ukrainian government attempted to 
develop new legislation to criminalize the persistent dissemination of disinformation, create a 
new ombudsperson io tackle disinformation, and oblige non-governmental media 
organizations to somehow merge to form a supervisory body that would accredit journalists 
and determine good-quality from bad-quality media.'’’ Ukrainian civil society was united in 
sirengly criticizing this approach, and the government dropped the idea. The weaponization 
cf the disinformation dilemma and caonsequentia! chilling effect erodes the intearity of 
journalism and information within societies. 


Some governments believe that internet shutdowns or slowdowns are a solution to the 
probiem; they are not. According to AccessNow, tne impact of shutdowns affects journalism 
and access to informaticn, education, refugees, healthcare. and business, not to mention 
violates the fundamental right to access to the internet as an essential right in the 21* 
century. 


Figure 11: Number of internet shutdowns in 2019 


Number of shutdowns by country in 2019 ~ 


Source: AccessNow trom #KeepltOn Campaign and research, 


AccessNow's #Keep/tOn campaign reported 216 internet shutdowns worldwide in 2079. 
These broadband and mobile network disruptions represent 1,706 total blackout days in 33 
countries.'** National and loca! governments thal implement internet or platform blackouts 
often justify the action as a measure of public safely or national security against the social 
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harms of fake news. However, internatianal free speech and press freedom advocate 
organizations denounce blackouts as authoritarian and hazardous during public crises where 
impediments to current and accurate information is life-threatening. Ine issue of internet 
shutdowns is important te monitor because it opens a pandora’'s box that tnreatens several 
areas USAID programming addresses and the use of broadband and mobile networks |s 
often critical to program outreach. Moreover, the economic impact of internet shutdowns is a 
big deal. They cest $2.4 billion between July 1, 2005 and June 30, 2016, according to tne 
Brookings Institution.'°? And, just a few years leader, the Irend worsened. Research firm 
TopiCVPN published a report tnat analyzed the econamic impact of internet shutdewns 
throughout the world in 2019. Their research traced 18,225 hours of internet shutdowns 
around the world in 2019 and noted that this carried a tetal economic loss of $8.05 billion.'™ 


The governments of Cameroon and 
Venezuela have also engaged in internet 
shutdowns and platforms bans. However, 
in both countries. the governments have 
used network access as leverace within 
existing political conflicts. In Cameroon, 
English-speaking regions lived witnoul 
internet access for 240 days in 2017. 
amid continued civil unrest. Similarly, in 
Venezuela. President Nicolas Madura has 
usec internet shutdowns frequently over 
the last seven years and, in tne last year, 
access to Facebook, SnapChat. 
Instagram, Google, Twitter. and YouTube 
vacillated during periods of heavy civilian 
protest. Both governments have wielded 
network access to stifle dissent. expand 
pluralistic ignorance, and silence 
oppositional voices in digital spaces. 


D. DEEPFAKES AND CHEAP FAKES 


In Southern Asia, where blackouts have 
become common, the Sri Lanka 
government disabled access to multiple 
platforms (Facedook, WnatsApp, 
YouTube, Instagram, SnapChat, and 
Viber) after the 2079 Easter bombings, 
claiming the bans protected citizens from 
misleading, unverified, or speculative 
content during the national crisis. The 
president also pointed at digital platforms 
as an enabling space for terrorism and 
hate groups, such as the one responsible 
for the bombings. The dan had a 
significant impact on the public in a 
country where Facebook is oftena 
primary means cf both news information 
and communication witn loved ones. 


Deepfakes are videos, images, and audio generated using artificial intelligence to 


synthetically render realistic depictions of speech and action.'*' Most notably, the technology 
has been used to manipulate facial exoressions and speech, as well as swap the faces of 
individuals into videos. While altered and manipulated content already circulates online, the 
development af deepfakes intended to misinform will “significantiy contribute to the 
continued erosion of faith in digital content.” according to Brookings.'** 
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People are more likely to have a visceral 
reaction to videos, images, and audio 
rather than text, so deepfakes propel a 
more rapid spread of altered media. 


Cheap fakes are audio-video 
manipulations created with cheaper, more 
accessible software (or none at all)." 
They may be subtle, such as slowing down 
the speed at which a video is played 
making it appear that the speaker's speech 
is slurred or altering the background or an 
otherwise insignificant aspect of a picture. 


Many Artificial Intelligence toals, including 
deepfake-specific technologies, have free 
and open access, enabling the creation of 
fake content to expand readily. '™ In the 
future. cheap fakes are likely to be 
uploaded by amateurs with satirical or 
political motives and influence campaigns 
of foreign origin or with advertising goals. 
However, despite their aim, cheap fakes’ 
wider proliferation in online spaces will 
further blur the authenticity of the digital 
world, ' 


To date, ongoing research and mitigation efforts have concentrated on automated deepfake 
detection, developing algorithms to recognize modified media. Academic studies have also 
uncovered indicators of deepfakes, including unnatural blinking patterns, distorted facial 
features, lighting inconsistencies, and more. '*® However, as deepfake technology continues 
to rapidly improve, these efforts are likely to be short lived. More funding and research are 
needed to support the discovery and development of longer-term solutions and tools to 
detect deepfakes. 


E. ARTIFICIAL INTELLIGENCE (Al)-GENERATED PROPAGANDA 


Previously, dubious media outiets, articles from nonexistent authors, troll factories, and 
comment armies have been deployed from Russia, Poland, Philippines, and elsewhere to 
saturate online spaces with fake content in order to manipulate public opinion.'*”? However, 
because writing articles, comments, and social media posts can be time consuming, those 
behind these operations often gave away indicators of their illegitimacy with their rapid 
activity, including plagiarizing or recycling writing, using stolen profile photos, and using 
repetitive phrasing in high volumes of text.'*® While these influence campaigns have been 
unraveled and attributed, advances in Al-generated content could eliminate these tells. 
leaving them untraceable. 


Emerging as the ideal too! for propaganda, Al-generative text resolves the time and effort 
needed for original content production. Artificial-intelligence research lab OpenA| has 


already released a beta version of GPT-3, a long-form text generator that works by taking 
text input and predicting what should follow.’ This tool reportedly can produce long-form 
articles, tweets, poems, and other texts that are difficult to distinguish from a human's 
writing. Tools like GPT-3 present yet another challenge for internet piatforms and users to 
discern what and whom to trust.'”° If people are left questioning whether content is tied to an 
actual person or an Al-generator, new divisions over verification of users and moderation on 
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platforms could also emerge.’ "' Those desiring more assurances of legitimacy may call for 
increased account verification or pnysica! existence validations on sites. Meanwhile. those in 
disagreement with increased moderation could tum to the alternative media systems with 
minimal restrictions. 
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VI PART SIX: WHAT ARE SOME EMERGING SOLUTIONS 
FOR DISINFORMATION? 


Emerging solutions for combating disinformation are coming from many different directions 
across sectors, including approaches to counter violent extremism, prevent hate speech, 
address national security and foreign interference, improve journalism, engage academia 
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and, education organizations, andenhance political communications, among others. 


Photo: ©2020 Shucterstock/EriAmmos 


Wardle and Derakhshan in their disinformation report for the Council of Europe provide 
recommendations targeted at technology companies, national governments, media 
organizations, civil society, education ministries, and funding bodies, with each broken into 
its own set of suggestions.’ (See table to find the recommendations.) 
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What could technology companies do? 


Craate an Intemational advisory council. 


Provide researchers with the data related to 
initiatives aimed al improving public discourse. 


Provide transparent criteria for any algorithmic 
changes that down-rank content. 


Work collaboratively. 


Highlight contextual details and build visual 
indicators. 


Eliminate financial incentives. 
Crack down on computational amplification. 
Adequately moderate non-English content 


What could national governments do? 


TT = Commission research to map information disorder. 
. 


Regulate ad networks, 
Require transparency around Facebook ads. 


What could media organizations do? 


Collaborate. 

Agrees policies on strategic silence. 

Ensure strong ethical standards across all media, 
Debunk sources as well as conient. 


Produce more news /iteracy segments and features. 


Pay attention to audio/visual forms of mis- and 
dis-information. 

Provide metadata to trusted partners, 

Build tact-checking and vorification tools. 

Build “authenticity engines” 

Work on solutions specifically aimed at 
minimizing the impact of filter bubbles: 

a. Let users customize feed and search 
algorithms. 6. Diversify exposure to different 
people and views. c. Allow users to. consume 
information privately. d. Change the terminology 
used by the social networks. 


Support public service media organizations and 
local news outiets. 


Roll out advanced cybersecurity training. 


Enforce minimum levels of public service news 


‘on to the platforms. 


Tell stories about the scale and threal posed by 
information disorder, 


Focus on improving the quality of headlines 
Do not disseminate fabricated content. 


What could civil society do? 


* Educate the public about the threat of information 
disorder. 


* Act as honest brokers 


What could education ministries do? 


* Work intemationally to create a standardized news 
lReracy curriculum. 

* Work with libraries. 

* Update journalism school curricula. 


What could funding bodies do? 


* Provide support for testing solutions. 

* Support technological solutions. 

- Support programs teaching people critical research 
and information skills, 
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What civil society and media can do 


Civil society through its groups, networks. and citizens acting on their own provides an 
important constituency in addressing mis/disinformation. And yet civi! society's critical role is 
sometimes not adequately supported. As Dr. Joan Donovan, director and lead researcher of 
the Technology and Social Cnange Research project at the Shorenstein Center at Harvard 
Kennedy School, has said, “The lack of attention to civil society responses |s a major gap in 
the research and it is becoming increasingly clear thal the guidance for journalists does net 
translate easily to civil society.""’* In order to activate citizen approaches. Denovan 
advocates a three-pronged approach for strengthening civil society to counter disinformation: 
Detect. Document, and Debunk (aka the 3Ds approach}. The 3Ds approach, however, takes 
time and a lot of research, planning, and strategy. The guidance and examples in Annex 5, 
Quick resources for Planning a Disinformation Strategy. may he!p with planning and design 
for civil sociely-led approaches to countering and preventing mis/disinformation. 


Supply-side responses (producers) 


Many approaches seek to address the “supply side” of disinformation and misinformation, 
attempting to limit the influx or supply of false or misleading information to media systems 
and publics.'’* The following 10 supply-side responses (fact-checking. redirecting, 
debunking, pre-bunking, legal/policy, counter-disiniormation campaigns. open-source 
intelligence, supporting local journalism support, and increasing transparency in journalism 
and advertiser outreach) are among the emerging practices that provide examples of how 
civil society groups and individual citizens are countering dis/misinformation by targeting it 
where and how il originates and spreads today. 


#l. PFACT“UCAECRKING APPROACHES 


Why does fact-checking matter, and is il effective? Fact-checking, just like journalism. is 
abaul informing audiences about the truth. Even if it is a limited audience, ar if people 
disagree, calling out disinformation attempts to nold people and institutions accountable. 
Sometimes fact-checxing efforts are picked up by larger outlets and reach wider audiences, 
but even if they are, publishing fact-checking is only the first step in an incremental process. 
When watchdogs expose untruths. this can become a resource for public action. particularly 
when mobilized by political campaigns or social movements. They can also identify trends 
and help trigger an institutional response by regulators, courts, or legislators. 


In ine last few years, fact-checking organizations have become more effeclive and grown 
tremendously. The Reporter's Lab hosts a database of reporting projects that regularly 
debunk political misintormation and viral hoaxes. As of 2019, the database counts 210 active 
fact-checking organizations in 16 countries. up from 59 sites tallied in 2014.'% 


Bringing these organizations together, tne International Fact Checking Network provides 
resources, monitors trends, and promotes basic standards for fact-checking organizations 
through its code of principles.’”* Many of these organizations work in USAID program 
countries; it is worth reaching out to hem when developing disinformation programming. A 
few examples of fact-checking organizations are included in Annex 3: Emerging Solutions. 


The Effecttveness of Fact-Checking 


The effectiveness in fact-checking is tne subject of numerous studies. These studies have 
otten produced contradictory results. In one key study, researchers from three universities 
teamed up to analyze the results of the studies and determine the effectiveness of fact- 
checking across research studies. The resulting study helps sned some light on the fact- 
checking landscape and the ins and outs of what works in fact cnecking. It found that: 
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@ Fact-checking with graphical elements is less effective than those without,'’’ and simple 
messages are more effective when informing the public on false information.'* 


e Fact-checking an entire statement rather than individual elements is more effective. 


e When tact-cnecking, debunking an idea is more effective when it is retuting ideas in line, 
as opposed to, a person's own ideologies.'” 


While it is important to consider the limitations of fact-checking—il is nol a panacea fer all 
disinformation—tact-checking is nighly prized by many people and is especially important for 
media outiets and others wno are in the business of investigating and reporting facts. 


#2: REDIRECTION METHOD 


The Redirect Method primarily relies on advertising using an online advertising platform such 
as Googie AdWords. targeting tools and algorithms to combat online radicalization that 
comes from the spread and threat of dangerous. misleading infermation, 


The method redirects users through ads who seek to access mis/disinformation online to 
curated YouTube videos uploaded by individuals around the world that debunk these posts, 
videos. or website messages. The Redirect Methog, a metned used to target individuals 
susceptible to ISIS radicalization via recruiting measures. \s being adapted in several 


nmrmiimerian tm Arretlheret eran haan oP oe orei's annw RADA annnrnalh 1#D THA mnAtran sarcue ArcvinlixzxnnsXt | rt 
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collaboration among private and civil society organizations and is documented on The 
Redirect Method website. The collaboration provides 44 steps in tne organization of an 
online redirect campaign, Other examples of the use of redirection are being employed by 
groups around the world. 


#3: DEBUNKING AND DISCREDITING 


The Global Engagement Center (GEC) at the U.S. Department of State recommends a 
combined debunking and discrediting approach, which is explained in GEC Counter- 
Disinformation Dispatches #2: Three Ways te Counter Disinformation and GEC Coumter- 
Disinformation Dispatches #4: What Works in Debunking. 


Key points include: 


# A “counter-brand” approach, which involves discrediting the "brana”—the credibility and 
reputation—of those making false allegations. 


e Highlighting false claims seen as obviously aosurd and particularly offensive and 
objectionable by target audiences 


@ Changing the frame from tne false allegation to the misdeeds and lack of credibility of 
those spreading disinformaticn 


e Creating moral outrage: truth is a sacrea value: spreading vicious disinformation violates 
this sacred value, creating moral outrage. 


e Recognizing that the mind often reasons by associations rather than logic. 
See the GEC Counter-Disinformation Dispatches for more details. 
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#4; PREBUNKING 


As a measure to counter disinformation anc 
make debunking more impactful, Donovan 
recommends prebunking, which she defines 
as “an offensive strategy that refers to 
anticipating what disinformation is likely to be 
repeatec by politicians. pundits, and 
provocateurs during key events and having 
already prepared a response based on past 
fact checks.”'®! Prebunking is drawn from 
inoculation theory, which seeks to explain how 
an atlitude cr belief can be protected against 
persuasion, and people can build up an 
immunity to mis/disinformation. 


Five Steps to Execute a Prebunking 
Strategy 


1) Take a look at fact-checking 
websites and databases to gel a 
sense of the trends in misinformation. 


2) Map out which misiniormation 
trencs are popular on Twitter (or other 
social media} in politicians’ stump 
speeches. 


3) Find aaditional source material with 
the facts about the misinformation 


Other researchers have alse pursued the likely to be repeated. 
prebunking track. including Dutch researcners 


who developed a game called Bad News,'** 4) Prepare your social networks for the 
which helps people spot misinformation and high potential for misinformation. 
disinformation. According to the developers, it ; 

helps people to talk about the truth and 5} Turn “prebunk into debunk” by 
reduces their susceptibility to misinformation. immediately posting correct 

Based on initial research of users who have information anywhere you can. Finally. 
played Bad News, it has been an effective in using prebunking techniques, she 
approach and led to improved psychological counsels that speed matters, 


immunity against online disinformatian. 2 —— & 

: ource. Ur. Joan Lonovan, orenstein 
Another prebunking game (funded by the Center, Harvard, (@BostonJoan). Tweets. 
Harmony Square. The theory behind this 
game also draws on inoculatian theory; learn 
more about this in this Harvard Misinformation 
Review article. 


#5: LEGAL AND POLICYMAKING ADVOCACY 


As information pollution and disinformation begin to affect the ways in wnich democracies 
function. governments have become aware of the importance of combating false information 
online. While there is government support to fing ways to combat the information disorder. 
democracies are struggling to find the best way to regulate disinformation online. There is an 
inherent contradiction between the cemocratic ideal of free speech anc the regulation of 
online cantent. Despite this. some governments have been developing policies that are 
intended ta combat tne spread of hate speech and disinformation. while simuhaneously 
working hard te preserve tree speech online. 


However, wnen democracies pass new laws to curb tne spread of disinformation, 
authoritarians can adopt these |aws as yet anotner tool to criminalize free expression. So. 
there is great risk of making ihe situation worse by regulating online speech. A very clear 
examole is Germany's NetzDG law (requiring social media to take down harmful content) 
thal was later adopted by Russia, Venezuela, and other countries as a means of silencing 
opposition.'** 


The Advisory Network to the Media Freedom Coalition, a group of 17 national, regional, and 
international organizations, delivered a statement at the ministerial meeting of the 2020 
Global Conference for Media Freedom and put forward the following guidance to support 
legal and policymaking agvocacy tnat seeks to dea! with the disinformation problem: 
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e Respect media freedom while tackling disinformation. 


e Efforts to combat disinformation and “fake news” must stan with governments, which 
should not criminalize this but also must commit to not perpetuating disinformation and 
fake news, 


# Counter the criminalization of journalism through so-called anti-fake news /aws and anti- 
terrorism laws. 


e Promote media engagemen in countering disinformation by expanding access to 
information mechanisms and by supporting jcurnalistic investigations revealing the 


sources and dissemination patterns of disinformation and highiighting tne role of 
government representatives in spreading disinformation." 


Because disinformation is considered a wicked problem, some have called for new ways to 
regulate the free flow of information with co-reguiatory models. Some ideas were outlined 


recently in the Disinformation as a wicked problem: Why we need co-requlatory frameworks 
policy-paper from Brookings Institution. '% 


To effectively manage disinformation and related online preblems, governments and 
platforms will need to develop an architecture to promote collaboration and build trust 
among stakeholders. There are several models for multi-stakenolder collaboration, 
among them tne industry-led Global Internet Forum to Counter Terrorism (GIFCT) and 
the government-led Information Sharing and Analysis Centers {ISACs). Those that prove 
successful have in common continuous adaptation and innovation and @ focus on trust- 
building and information-snaring. 


A few examples of resources for legal and policy approaches are included in Annex 3: 
Emerging Solutions. 


#7: MESSAGING CAMPAIGNS 


Messaging campaigns have provided a new front where disinformation can easily spread to 
large amounts of people. Messaging campaigns refer to messages that contain false 
information that pass through networks like Facebook Messenger. Twitter Direct Message. 
and WhatsApp private and group messaging. These large-scale campaigns are difficult to 
lrack because of the encryption securily available on most messaging apps. Despite this 
increased difficulty, there are new top-down and bottom-up approaches that are being 
utilized to help stop the prevalence of messaging disinformation campaigns. 


A few examples of resources coumer-disinformation campaigns are included in Annex 3: 
Emerging Solutions. 


#8 LOCAL JOURNALISM SUPPORT 


Boilstering local journalism is key to countering and preventing disinformation. Two pivetal 
Studies provide an evidence-based set of findings that show why Support to quality, 
independent media is key. One study notes that “results |ndicate local newspapers hold their 
governments accountable, keeping municipal borrowing costs low and ultimately saving local 
taxpayers money.”'"’ A second stuay observed, ‘We find newspapers have a robust positive 
effect on political participation, with one additicna! newspaper |ncreasing both presidential 
and congressional! turnout by approximately 0.3 percentage points.“’*Furthermore. major 
research undertaken by the United Nations and the Internationa! Center for Journalists cited 
Guality journalism as a major force for identifying and exposing disinformation, '® citing that 
the ‘viral load’ of disinformation will only grow if journalism continues to suffer death blows 
inflicted by the (COVID-19} pandemic, The importance of good, quality local journalisrn as 
the key to fighting false news and noxious content was nicely argued in a pair of articles 
written by Emily Bell at the Tow Center for Digital Journalism at Columbia University's 
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Graduate School of Journalism and a Guardian columnist and by Alan Rusbridger former 


editor of the Guardian and Chair of the Reuters Institute for the Study of Journalism. As 
Rusbridger sums it up “against evasion and lies. good journalism is all we have'" 


As social media nas expanded as a primary way for many individuals to receive their news, 
there has been a decrease in funding for local journalism and a need for better support.'*' 
This change is largely a result of advertising revenue that is being redirected towards online 
media sources. Tota! global newspaper advertising revenue may lose about $23.8 oillion in 
annual revenues from 2012 to 2021, More than 10 percent of this decline. around $3 billion, 
is an estimated loss of annual revenue tor local news media around tne world.’ Television 
news js still holding its own in places such as the Philippines; nowever, more than 80 
percent of Filipinos say they now go online for their news anc spend four of their 10 hours 
online accessing social media.'*- 


In the vacuum created by the loss of local newspapers, the Brookings Institution finds that 
readers turned to ouilets coverina national stories thal may have strong partisan leanings or 
concentrate on partisan conflict." As a result. Brookings observed that “in places where 
news consumers cannot balance their news diet with local alternatives. voters tend to be 
mare politically polarized.”'°° Understandina the value of local journalism and the challenges 
it faces, some civil Society organizations have committed themselves to revitalizing and 
protecting local news efforts. Through providing funding. training, and other resources to 
journalists and local outlets, organizations ensure that communities have sustained access 
to information through @ more local lens and without a dependence on large-scale, 
potentially partisan media houses. 
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Some prominent international organizations acting in this space include: 


Internews builds lasting change by ensuring people have access to quality, local information. 
To do so, Internews works with local partners to grow sustainable organizations and offers 
capacity-building programs for media professions, human rights activists, and information 
entrepreneurs, 


IREX promotes “vibrant information and media systems.” IREX supports journalism and media 
organizations through trainings on reporting, media law, media safety, and digital security. 
IREX also provides additional support to consumers via media iteracy programs, training 
citizen journalists, and diversifying and distributing television content. 


International Center for Journalists (ICFJ) seeks to build the expertise and storytelling skills of 
journalists around the world. ICFJ focuses on five key areas: news innovation, investigative 
reporting, global exchange programs, specialty journalism, and diversity promotion.'** 
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Over the years. media development civil society organizations have been formed and have 
become active in most parts of the world. A useful list of local, regional, and international 
organizations can be found at the Global Forum ter Media Development. 


#9 TRANSPARENCY IN JOURNALISM 


As the spreac of disinformation online grows and even reputable news agencies have 
mistakenly shared false information, there is 2 need for better trust and transparency 
standards to hold media agencies accountable. Some very basic standards such as bylined 
articles, public display of address and registration information, and disclosure of funding 
sources and editorial board, for example, can assist readers to understand the sources and 
reliability of the information they read, By develepirig standards for media agencies, 
journalism will be held to greater account for what it publishes. Examples of angoing 
initiatives aimed at rebuilding trust and strengthening transparency in journalism are included 
in Annex 3: Emerging Solutions. 


#10 ADVERTISER OUTREACH 


In order te disrupt the funding and financial incentive to aisinform, attention has also turned 
to the advertising industry. particularly with online advertising, A good example of this is the 
concerted response to the discavery of the websites traced to the village of Veles outside of 
Skopje. Macedonia, which showed how easy il was to exploit the digital advertising medel ta 
flood the news ecosystem with fabricatea content. Wired Magazine profiled ine Veles case 
study in 2017. 


As most on|ine advertisers are unaware of the disintormation risk of the domains featuring 
their ads due to tne automated process of ad placement. they inadvertently are funding and 
amplifying platforms that disinform.*"° Thus, cutting this financial support found in the ad-tech 
space would obstruct disinformaticn actors from spreading messaging online. Efforts have 
been made to inform advertisers of their risks, such as the threat to brand safety by being 
placed next to objectionable content, through conducting research and assessments of 
enline media content. Additionally. with this data, organizations hope to aim to redirect 
funding to higher-quality news domains, improve regulatory and market environments, and 
support innovative and sustainable mode's for increasing revenues and reach. 


A tew examples of advertiser outreach are included in Annex 3: Emerging Solutions. 


Demand-Side Solutions 


Other groups have centered their efforts on targeting the opposite side of disinformation, the 
"demand. With demand-side solutions, the focus shifts to reducing the general societal 
acceptance or tolerance of distorted and fabricated items.*°' These approaches are often 
viewed as more important for sustaining long-term impacts as they concentrate on why and 
how disinformation influences society and tne strategies to develop societal resilience 
against it. Different demand-side solutions often look to governments, tech giants, and social 
media companies to premote education and training, raise awareness, or advance other 
efferis toward builcing more resilience against disinformation. 
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MEDIA LITERACY, EDUCATION & TRAINING 


In response to today s challenging information environment, many civil society organizations 
view media literacy, education and training programs as critical mechanisms for hardening 
communities againsi disinformation. These projects strive to assist consumers in 
understanding how to access, assess, and critically evaluate different types of media. as well 
as process and analyze media messages. They seek to promole tne development of healthy 
habits and behaviors for information consumers and provide them with the tools and other 
resources for identifying accurate, high-quality content from aisinformation. 


A few examples of media literacy, education and training are included in Annex 3: Emerging 
Solutions. 


CIVIL SOCIETY ADVOCACY AND PUBLIC AWARENESS CAMPAIGNS 


A multitude of civil society organizations. beth local and international, are pushing for better 
accountability and transparency. Other approaches are concentrating on providing research 
and advocacy on the vulnerability of countries to disinformation and exposure. 


To build societal resilience against disinformation, the public must be aware of and 
understand the issue. Public awareness campaigns serve to inform and educate 
communities about aisinformation. build public recognition of it, and promote actions or other 
resources for combating il. 


A tew exarnples of civil society advocacy and public awareness campaigns included in 
Annex 3: Emeraing Solutions. 


DIGITAL LITERACY & SECURITY 


Civil society organizations have also sought to increase digital literacy and security skills to 
empower the online community to identify and counter disinformation. Digital \iteracy 
trainings provide lessons and resources for understanding how to identify, evaluate, and 
compose information on aigita!l platforms. This type af literacy expands understanding of how 
to navigate. read, and interpret ina digital environment, as opposed to media literacy that 
focuses primarily on understanding and interpreting journalism. Furthermore, digital security 
initiatives produce and provide tools and behaviors for maintaining safety of personal 
identities and information online that protect people and groups from becoming the target of 
mis/disinfermation, 


An example is the Digital Society Project, which seeks to provide data on the intersection of 
politics and social media. Topics include online censership, polarization, misinformation 
campaigns, coordinated information operations, and foreign influence in and monitoring of 
domestic politics. It uses the Varieties of Democracy (V-Demi framework, also used by 
USAID in Journey to Self-Reliance (JSR) metrics, to assess various aigital issues including 
misinformation. 
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Elections-focused programming efforts {both supply- and demand-side solution) 


To defend the integrity of democratic elections worldwide, reducing disinformation has been 
centra! to elections-focused programming in all these commen goals: 


* Building the capacity of election management bodies to combat disinfermation during 
electoral periods. 


e Sirencthening and adapting citizen election observation to incorporate disintormation 
monitoring and exposure efforts. 


@ Adapting international election observation ta integrate monitoring of tne iniormation 
environment, including social media. 


e Supporting independent media election coverage capacity and resources to increase the 
supply of accurate information during elections. 


* Increasing incentives for ethical online conduct by political parties and campaigns {such 
as facilitating norms for online Codes of Ethics for political parties). 


As social media has changed how audiences consume and spread political information, 
focus has shifted ta monitoring the transformed information environment before and during 
election periods. Emphasis has been placed on cilizen election and campaign finance 
monitoring, focusing on exposing disinformation on secia! media ano other digital platiorms 
during election campaigns. Election management bodies (EMBs} tend to have significant 
power to regulate speech and can set some ground rules. Media platforms have been 
compelled by EMBs to be transparent about political advertising auring an election season. 


A report produced by the Kofi Annan Cammission on Elections and Democracy in the Digital 
Age puts forward recommendations te governments and internet platforms to safeguard the 
legitimacy of elections. As the report notes. “For the foreseeable future, elections in the 
democracies of the Global South will 5€ focal points for networked hale speech. 
disinformation, external interference, and domestic manipulation.“°* 


Disinformation assessments have also been incorporated within international election 
cbservation and management missions. With this, organizations have offered trainings and 
guidance for election bodies and other stakeholders in regulating speech, campaign 
violations. and the prosecution of violations. 


A few examples of elections-focused programming and disinformation assessments are 
included in Annex 3: Emerging Solutions. 


There is also advocacy working to motivate social networking platforms, advertisers, 
governments, and oiher parties to impreve the information environment with pertinence to 
the integrity of elections. In particular. advocacy aimed to achieve greater transparency in 


I TT ee en a ns oe ta 6 er ee Poe ee bt en en oe a ey en een ee 
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disinformation. An example of this is European Commission's "Code of Practice on 
Disinformation,” a self-regulatory Code of Practice to fight disinformation and ensure 
transparent, fair and trustworthy online campaign activities ahead of the 2019 European 
elections. Signatories included Facebook, Google, Twitter, Mozilla, Micresoft. and TikTok.*¥ 
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In more closed environmenis, with governments seeking lo suppress opposition, trainings for 
political candidates, parties. and activists have become valuable resources for learning how 
to disseminate messages in adverse and media-saturated communities. An example of this 
work in More closed environments is NDI's ‘Raising Voices in Closina Spaces,” a workbook 
offering a step-by-step approach to strategic communications planning for citizen election 
cbservation groups and other civil society organizations to break through in closing or closed 
political environments. The guide offers strategies, tactics. and hypothetical and real-worid 
examples for overcoming challenges in repressive environments.<° 


A, WHAT GOVERNMENTS CAN DO 


Governments allocate state resources and execute strategies in order to protect their 
citizens and the integrity of their information systems/democracy from tne harms imposed by 
information disorder, This proves difficult to accomplish through traditional. analog legislative 
aclion because disinformation networks transcend the natianal borders where legislative 
mandates are confined. We will examine delow several countries that have attempted to 
cuell the production and dissemination of disinformation through legal and regulatory 
measures. 


Thougn it can be well-intentioned, criminalizing tne spread of disinformation in digital spaces 
presents even more negalive ramifications for democratic governance. In countries where 
oisintormation legislation has been introduced, creating or sharing aigital cantent and 
information becomes risky and punishable. Tne resulting chilling effect utimately hampers 
democratic protections for a free press and the freedom of expression. Likewise, any whole 
scale internet or platiorm shutdowns pose the same anti-democratic results while also 
creating information vacuums within communities amid public nealth or safety crises, As 
USAID negotiates the entangled, disinfermation landscapes thal intersect global and loca! 
programming. programs should be wary both of legislative etforis to limit expression online 
and internet’platform blackouts for the dangers they pose to democracy. 


1. Whole-of-Government Approaches 


There are very few examples of whole-of-government approaches (integrated activities of 
government agencies increasing coherence jn policy development on an issue} in the 
disinformation space. Policymaking is likely to take time and will need to be significantly 
informed by the private sector and civil society, Two examples in Scandinavia are discussed 


try alla tctrata thie annraarh 


BNE SUNOS RAO OF ORAM LAP! WANE 


Some governments have seen success in whcle-ol-government approaches in which 
government agencies. social institutions. and civil society collaborate to collectively close the 
digital, education, and social fissures that disinformation campaigns need to infiltrate media 
and politica! landscapes. 


In Sweden, for example, the whole-of-government approach {a comprehensive approach 
that involves government, private and civil society sectors and media) atiempis to be as 
multi-faceted as the issue itself. Focused on maintaining the integrily of its electoral 
processes, lhe Swedish government has poured resources into shoring up its electcral 
infrastructure by safeguarding electronic voting macnines and providing new training for civ|| 
servants and voting officials. The government. electoral bureaus and cybersecurity agencies 
have committed to forming an inter-agency cooperative to combat the issue.**? Sweden has 
also focused on bettering public media literacy through enhancing high scnool curriculums 
as a long-term strategy against information disorder, Lastly, five of tne country’s most 
prominent media news outlets have created a scrupulous and highly visible fact-checking 
collaboration to maintain the integrity of Swedish media and spread mutual oversight over 
multiple media stakeholders.“* Sweden's approach has required weaving together 
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resources to defend the many susceptible ports of entry that misinformation and 
disinformation penetrate in media landscapes and societies. 


In Finland, response to the global information crisis has included a sweeping media literacy 
education effort. In junior high and high schools, Finnisn students use a digital literacy taolkit 
in order to understand how to implement best practices in their own socia| media 
engagement. In the world of electoral and media professions. Finland has dedicatea 
resources lo disinformation trainings and workshops for civil servants and journalists.*”" This 
approacn seeks use of public pedagogy and a more robust media literacy secondary 
curriculum to intervene at every level of societal strata, in hopes that many small 
contributions by individuals will add up to big structural changes that make a nation less 
vulnerable to disinformation. Critics of the Finnish strategy cal! it too slow moving to address 
such a fast-moving problem and worry that there are not concrete ways to measure its 
success.“*° Taiwan and Lithuania provide other good examples of whole-of government 


approacnes te mis/disinformation.©°° 


2. Strategic communications and State coalitions 


On a broader scale than the individua! efforts of governments within their respective 
countries, coalitions among states and policy stakenolders are expanaing global etfors to 
fight disinformation, sucn as EUvsDisinfo and the Atlantic Council. 


The EUysDisinio is a flagship strategic communications project of the European External 
Action Services. East StratCom Taskforce since 2015 to “increase public awareness and 
understanding of the Kremlin's disinformation operations, and to help citizens in Europe and 
beyond develop resistance to digital disinformation and media manipulation.”*'? EUvsDisinfo 
has hands in three majer areas to stymie gicbal disinformation. The project conducts data 
analytics of media spaces to identify and publicize disinformation campaigns started by the 
Kremlin of pro-Kremlin media outlets; the data is archived in an open-source, dedicated 
database that tracks disinformation around the world. The project also publishes summaries, 
articles, anc reports both within tne research community anc for wider general readership in 


order to make a technical and complex issue accessible to the broader global communities it 
impacts. Lastly, EUvsDisinfo engages with governments. media oullets. universities, and 
civil sociely organizations by offering training resources to betler prepare and problem-solve 
around |ssues of information disorder. 


Another example of stratecic communications is The Atlantic Council, a “nonpartisan 
organization that galvanizes U.S. leadership and engagement in the world, with allies and 
partners. to snape solutions to global challenges.“*"' Among the numerous capacities 
through which Atlantic Council conducts international work. their recently published 
Democratic Defense against Disinformation 2.0 provides a current snapshot of global 
gisinformation campaigns at work, including proposed solutions, progress made, and 
criticisms and recommendations made to the U.S, executive and judiciary branches 
regarding urgent steps needed in the path toward a healthier information ecosystem. 


3. Legal and regulatory measures 


While there are examples of legal and regulatory measures intended te address 
disinformation, the difficuhy is that many are controversial because they also restrict freedom 
of expression, 
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To achieve good legal and requiatory approaches to disinformation wil! require civil sociely 
and independent media organizations to have a significant voice in policymaking through 
multi-stakenolder collaboration. Governments tace very real tradeotfs in developing 
regulations on dig tal rights, disinformation and dangerous speech, while balancing 
protections for freedom of speech, transparency, and privacy. Regime type is an important 
variable to consider. 


Guidance on goed practices regarding regulation and policymaking in this area was put 
forward by tne UN Special Rapporteur on Freedom of Opinion and Expression, the 
Organization for Security ana Co-operation in Europe (OSCE) Hepresemative on Freedom 
of the Media. the OAS Special Rapporteur on Freedom of Expression and the African 
Commission cn Human and Peoples’ Rights (ACHPR) Special Rapporteur on Freedom of 
Expression and Access to Information, with Article 19 and the Center for Law and 
Democracy. These standards can be useful in evaluating legal and policymaking processes 
and frameworks; some important ones are excerpied nere from the section on Standards on 
Disinformation and Propaganda: 


a) Genera! prohibitions on the dissemination of information based on vague and 
ambiguous ideas, including “false news’ or “non-cbjective information,” are incompatible 
with international standards for restrictions on freedom of expression, as set out in 
paragraph 7(a}. and should be abolished. 


b) Criminal defamation laws are unduly restrictive and should be abolished. Civil law 
rules on liability for false and defamatory statements are legitimate only if defendants are 
given a full oppertunity and fail to prove the truth of those statements and benefit fram 
other defenses. such as fair comment. 


c) State actors should not make, sponsor. encourage, or further disseminate statements 
which they know or reasonably should know to be false (cisinformation) or which 
demonstrate a reckless disregard for verifiable information (oropaganda). 


d) State actors should. in accordance with their domestic anda international legal 
obligations and their public duties, take care to ensure that they disseminate reliable and 
trustworthy information, including about matters of public interest. such as the economy, 
public health, security, and the environment.2* 


B. WHAT SOCIAL MEDIA PLATFORMS CAN DO 


The issue of misinformation reminds many of the saying. “A lie can travel halfway around the 
world while the truth is putting on its shees."*’- This saying becomes especially concerning in 
reference to social media platforms, whose technologies have significantly impacted the 
ways in which people communicate and snare information. Because social media offers free, 
open access to reach widespread global publics, discussions have turned to calling for the 
platforms to respond ta the online environments and issues they have created. More 
specifically, focus has narrowed in on social media's automated algorithms that have 
provided an easy and rapid mechanism for misinformation to spread and be amplified, 
leaving truth to be buried amongst this free reach of falsehoeds.*"* Thus. critics argue tnat 
social media platforms must take greater responsibility for |hemselves and increase platform 
reguiation and oversight and question whether self-regulation is sufficient. 


With the algorithms of Facebook, Google, Twitler, and the other social media plattorms 
driving how people access and consume today's information, these organizations hold the 
power to change the way information tlows online and to address the conditions they created 
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for enabling misinformation to flourish.*'? Social media 


companies’ business models amplify and further “Itis difficult for the truth to 
complicate the existing issues of misinformation, get out if someone shares 
disinformation, and malintormation. Although these falsehoods and benefits 
companies are part of this problem, they can and will need from free reach and — 

to be collaborators for determining solutions and best automated algorithmic 
practices. amplification. The facts 


must be given a chance for 
a proportional response.” 


—Joshua Lowcock, chief 
digital and global brand safety 
officer at Universal McGann 


What is platform accountability? 


As explained in previous sections of the primer, the ability 
for forms of disinformation and misinformation to spread 
rapidly via social media positions social madia companies 
not only as gatekeepers and facilitators of information- 
sharing and communication. out also for politica! 
interaction and engagement. Thus, policymakers, civ'l society, academia, and the public 
have become increasingly interested in understanding the polilical implications of social 
media, calling for operations that wou|d make the platforms more democratically 
accountable.*" Tactics to expose disintormation—such as: 1} fact-checking, 2) content 
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initiatives have been growing in response to increased awareness of disinformation: for 
example, see Facebook's Community Standards Enforcement Repon. 


In considering how and by whom platforms should be held accountable, discussion extends 
to platiorm governance. Robert Gorwa, a scholar from the University of Oxford, explains 
platform govemance as an “approach necessitating an understanding of technical systems 
{plattorms) and an appreciation for tne inherently global arena within which these platform 
companies’ function."*'’ In essence, the approach necessitates more knowledge about how 
platforms govern or influence publics via their platform practices, policies, and affordances 
while also acknowledging that their conduct is informed by local, national, or international 
forms of governance. ** 


Currently, there are three governance ‘lenses’ being utilized for thinking about social media 
platform regulation and policy: 1) self-regulation, 2) external governance, and 3) co- 
governance. The first lens represents the presently dominant mode of governance, a rather 
laissez-faire relationship dDetween governing institutions and social media companies, in 
which the companies dictate their own platform improvements and transparency efforts. The 
second lens encapsulates governments enacting legisiation regulating social media 
platforms. Lastly, the third lens seeks to provide greater dernocratic accountability without 
severe disruption to the stalus quo. As noted earlier. he challenge with this approach is 
striking a oalance between combatting the spread of disinformation and harmful content 
while alse preserving free expression online. Proponents of this lens nave proposed the 
creation of specialty organizations, third-party adjudication systems. or ombudsman 
programs thal would act to address and invest gate platform complaints as well as set ethical 
frameworks and standards, among other tasks.*"” Some examples are ICANN. a not-for- 
protit, public benefit organization that regulates domain names, and the Internet Governance 
Forum, which includes all stakeholders on governance questions in open and inclusive fora. 


Current platform initiatives 


As a result of public concern, this has become an exciting and rapidly moving space where 
platforms are developing solutions to be responsible to their consumers, as well as where 
government and civil society organizations are leading additional efforts to influence platform 
intiatives. There are many discussions about the unrequlated power of social media and 
other digital platforms. Below is a non-exhaustive list of how social media companies are 
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creating solutions internally and how global civil society groups and human rights defenders 
are encouraging greater platform accountability. 


Models for Platiorm Governance: An essay series on global platforms’ emerging economic 
and social power, Centre for Internatianal Governance Innovation 


Content Requiation and Human Rights, Global Network Initiative 
The following table highlights a few social media initiatives (as of late 2020) to address 


disinformation and misinformation. 


Media 


Social 
Initiative Platform 


Notes 


Fact-Checking \Faceboo 
Program 


Oversight Board ‘Facebook 


Expansion of Hate |Facebook 
Speech Policy to 

Include Holocaust 

Denial 


New Warning Twitter 
Labels about 

COVID-13 

Information 


Birdwatch Twitter 


Encouraging Users (Twitter 
to Read Articles 


Before Sharing 


With a three-step approach of “identify, review and act,” Facebook has 
independent fact-checkers assess and rate the accuracy of stories through 
‘original research, Facebook may act by reducing cistrioution, including 
sharing warnings, notifying previous sharers of misinformation, applying 
imisinformation labels, and removing incentives for repeat offenders.2*° 

L his Internationally diverse group formed to protect treedom of expression by 
making independent decisions on content issues and providing policy 
advisory opinions to Facebook.**' Note: Facebook's Oversight Board has 
been the subject of much criticism, as highlighted in an article in the Harvard 
|Business Review“? 7 ~~ = 

In response to the rise in anti-Semitism globally, Facebook expanded its hate 
‘speech policy to include Holocaust denial. Any content that “denies or distorts 
ihe Holocaust” is now banned, Note: Facebook's decision to undertake action 
on hate speech related to Holocaust denial is also perceived with skepticism 
‘and critique. 

Twitter added new labels on tweets about COVID-19 that link ta a Twitter- 
‘curated page or external trusted source for additional information on the 
‘claims of the tweet. Tweets conflicting with public health experts would be 
covered by a warning from Twitter. Misleading information with a severe 
ipropensily for harm would be removed frorn the site.°°* 

‘Twitter is potentially developing a new product called “Birdwatch,” which will 
likely involve crowdsourcing to address disinformation and provide more 
‘context for tweets in the form of notes. 

‘Twitter tested a feature on Android that will prompt a message suggesting the 
user should read an article before sharing it.<* 


“ Regarding Facebook, numerous experts from academia, journalism, civil society, 
government, and other sectors point out the outsize problem that the company creates in 
terms of the spread of disinformation. These critiques make clear that the social media giant 
struggies to strike a balance between allowing free expression and enabling the spread of 
potentially dangerous hate speech, extremism and disinformation.**° These concerns should 
be taken very seriously, as Facebook is the biggest social network in the world, with more 


than 2.7 billion users.*”* 
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CAN DO TO COUNTER AND PREVENT DISINFORMATION 


As noted in the primer's introduction, information disorder is a wicked problem, Like other 
seemingly insurmountable challenges, there is a need to tackle the problem in a number of 
ways. Any solutions to the root causes of information disorder will need to work in concert 
with other issues, such as better governance, cleaner elections, stronger accountability—the 


whole spectrum of DRG issues. Simply put, disinformation ts the big spoiler of all the DRG 
issues, It's not just about doing one little thing, however; it's about a lot of little things, done in 
an interactive, adaptive way and over a period of time. 


Photo: ©2020 Shurterstock/Chanonnat Srisura 


While it may nol be possible to eradicate information disorder, doing nothing is not an 
option. There are steps that must be taken to help alleviate the problem and ensure that the 
progress and successes USAID nas made around the world are not jeopardized. 


Note: you will want to make your work as context specific as possible and do original, 
diagnostic research to determine the best course of action for implementing more effective 
strategies, 


A. TEN STEPS FOR DEALING WITH DISINFORMATION 


1) Conduct a disinformation diagnostic. Take stock of the information environment in your 
country. The Public Affairs Section, the Bureau of Intelligence and Research, and/or the 
Global Engagement Center at the State Department may have some information, often 
on a smaller scale. The assessment could be part of a standalone media program or 
integrated into larger governance programming. An assessment should understand 
cultural notions attached to information legitimacy and norms for accepting the veracity 
of information. Some regions are culturally preconditioned to be much more skeptical 
(e.9., former Soviet republics) while others experience wide deference to authorities 
{many Asian societies). 
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An assessment would look for answers to the following questions. 


a. What are the biggest threats/vulnerabilities for disinformation? 


a. What are likely disinformation themes, aims. and main sources of 
disinformation? 


b. Who is most vulnerable to the disinformation being spread’? 

c. What are the common disinformation narratives? 

d. Who are the main disinformation purveyors? 

e. How does it spread across communities. and who are the mest vulnerable? 
b. What is the media ecosystem in your country like? 


a. Whatis the makeup of mainstream media, including state. pudlic service, and 
private media as wel! as community media and alternative media? 


b. What is the social media landscape like in your country, and what are the 
most popular platforms (i.e., Facebook. Twitter, WhatsApp. etc.}? 


c. What are tne mast common ways that different segments of the population 
consume information? 


d. Where do different people get their information? Is it online or through TV, 
radio, print or peer-lo-peer sources? 
e. How do people access the internet? (mobile/desktop) 
What is the media literacy landscape? What are the media literacy levels? 
d. What's the rate of mobile and internet penetration? 


e. What does current research say about the state and nature of tne media and social 
media, ineluding levels of press freedom, internet freedom and any threats or 
vulnerabilities thal exist regarding access to |ntormalion???" 


2) Carry out actor mapping. Assess the key stakenalders who contribute in pesitive and 
negative ways to the media and information ecosystem in your country. 


a. Who are the malign actors? 


b. Are there civil society organizations. associations, or institutions that seek to root out 
disinformation, increase public awareness, engage in fact cnecking, or contribule in a 
positive way to countering the disinformation problem? 


c. Who are the allies, and who are the foes? Are tnere meaia, civil society. academics, 
think tanks, businesses, or government agencies that you can work with? 


d, Are there gaps in the actors (fact-checking or media development crganizations, for 
example}, and could these gaps be addressed by partnering witn international CSOs 
or companies? 


3) Support media literacy initiatives. Given ihe changing nature of mass media and news 
and information consumption habits, youth as well as other segments of the population 
benefit from opportunities to learn critical thinking skills and to acquire tne knowledge to 
spot disinformation and other aspects of infermation disorder. Participants of media 
literacy programming can also serve as good boosters or spreaders of critical thinking. 


USAID.GOV DISINFORMATION PRIMER | 60 


FL-2023-00013 A-00000748592 “"UINCLASSIFIED" 2/27/2024 Page 70 


4) 


5) 


6) 


7) 


FOR INTERNAL USE ONLY 


However, media literacy, ||ke other aspects of knowledge and learning, requires “booster 
snois” in which individuals learning about how the system works can get Updated skills 
ang knowledge on new developments ana techniques of media manipulation. Efforts to 
get media literacy into the curriculum of primary and secondary schools cn a broad scale 
are considered best practice, but media literacy programs can be run through schools, 
libraries, and other community-level partnerships, and they should be integrated across 
Subjects, as well as serve as part ol a civic education curriculum. If possible, they should 
also target a variety of age groups, from children to adults and seniors. As part of media 
literacy effors. include ideas and tactics for prebunking. 


Fund independent media and local public interest journalism. High-quality, 
independent, local news is under threal. Endangered by changing business models, big 
tech’s domination of the digital advertising market, and pressures stemming from media 
Capiure, concerns over press freedom, and the overall safety of journalists, the future of 
news will require substantial investment and partnership with donors as well as 
experimentation with different models and approaches. As advocated by the Knight 
Foundation. one of the best forms of resilience against mis- and disinformation is 
journalis.*** 


Support media monitoring and fact-checking initiatives specifically. As shared by 
Lithuania s Elves in their fight against the disinformation trolls, yeu cannot fight 
disinformation with disinformation. You need to fignt back with the trutn and good 
reporting. Local actors also need to know where and how disinformation is spreading. 
This same sentiment is shared by leacing journalists and experts on disinformation, who 
argue that the best defense againsi the lies, propaganda, conspiracy theories, and other 
bad information that is circulating is the truth.?*° Truth, transparency, and facts are an 
essential piece of fighting back against the wicked problem of information disorder. 
Distortion of the facts is a moving target, so the ability to do fact-checking needs to be 
sustained over time. 


Stay up to speed. Disinformation is a growing field and threat, and there is a need to 
stay current on new research and tools for identifying disinformation trenas and threats 
and to stay abreast of tne different disinformation narratives that could undermine 
USAID's work. While this requires sustained effort, the cost of |nattention is too high f 
ignored. 


Support internet governance and digital rights Initiatives. Digitalization and the 
spread of internet technologies has already led to the next frontier of information access. 
lt has, unforiunately, also provided ancther way to prevent cilizens from accessing 
information. Criminals and politicians are known to muddy the waters and engage in 
malign activities, often using tne internet and the disinformation playbook te gain money 
ano power. Just as human rights advocates have argued that internet access is 2 human 
right and that there is a fundamental right to access of infermation, there is also a right 
nol to be disinformed, The internet freedom and digital rgnts sector that USAID has 
supported and partnered with around the wor'd is a vital source of expertise and 
collaboration in the fight against disinformation. Consider potential partnerships with 
digital security trainers, digital forensic investigators, digital \iteracy specialists, internet 
governance experts, and others who can work with your local USAID programs as part of 
democracy and governance programs, For example, working with the Internews-led 
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Internel Freedom Consortium, a program funded by USAID, can nelp io address these 
issues in countries where USAID works .?*° 


Engage government. V¥here it is possible, reach out to local government and naticnal 
government officials to begin a dialogue. if one is not already in place, about how USAID 
can partner in countering and preventing disinformation. The information disorder 
problem puts USAID’s work at risk, but il also tarnishes local economies, jeopardizes 
public health systems, and wreaks havoc on peace and stability. USAID can be a 
positive partner in putting out strategic messaging and countering disinformation 
narratives that may occur in a given country. USAID can also partner with ministries and 
schools to support media literacy efforts or broker partnerships to helo support 
investments in needed infrastructure or systems required to counter and prevent 
disinformation. 


Collaborate and engage with other international partners (civil society. media, social 
media platforms, internet governance forums, and other donors). Countering and 
preveming disinformation programming is a grewing field and ane thal is likely to be a 
major component of programs for some time to come. Given the rising influence of soth 
Cninese- and Russian-backed disinformation efforts that pul USAID's democracy and 
governance programs at risk, !ook for ways to form synergies with others working to 
support and strengthen democracy in the country where you operate. Callaborative 
partnership will be stronger, and funding can be better leveraged 10 support smarter 
program designs. with shared goals and objectives to help local civil society, human 
rights organizations. and independent media firmly establish thelr presence as part of 
efforts to combat the information disorder problem. As part of a push jor collaboration, 
support mullidisciplinary approaches, Some of the best examples in countering and 
prevemting disinformation involve collaborative approaches that include data scientists, 
social scientists, and journalists. 


10} Measure the impact of your efforts to counter and prevent disinformation. 


Monitoring and evaluation (M&E}) are vital to helping USAID colleagues and others 
understand the relevance, effectiveness, efficiency, and impact of countering 
disinformalicn programs. Because there are so many unknewns in terms of what works 
ano what does nct in the field of countering disinformation, research and learning 
opportunities are important, and data collected should be shared with both USAID and its 
implementing pariners. To support rebust M&E, partner with local research firms, 
institutes or universities. There is a growing number of specialists with the right research 
skills and social science and computer Science training lo Support your M&E programs in 
this space. Key skills include: social network analysis, content analysis and media 
monitoring, discourse and narrative analysis, and social media analysis. Before you 
begin new programs. make sure to capture baseline data, and include appropriate funds 
to also carry oul an endline study. The “before and after’ aspects of what you can 
capiure through M&E are essential to program reporting. 
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ANNEX I: GLOSSARY OF TERMS 


The field of disinformation has a particular lexicon: a stock of terms used to study and 
understand the broader field of information disorder and a particular vocabulary that is used 
by scholars and practitioners writing about the phenomenon. Definitions are collected fram 
leading sources in the disinformation field. 


Term 
Algorithm 


Artificial Intelligence 


Astroturting 


Backfire Effect 


Black box algorithms’ 
Black hat SEO (search 
engine optimization) 


Bot 


Cheap Fakes 


Clickbait 


Computational 
propaganda 


Content Farm 


Content Moderation 


Definition 
An algorithm is a fixed series of steps that a computer performs in order to solve a 
problem or complete a task. For instance, socia) media platforms use algorithms to 
compile the content that users see. These algorithms are designed to show users 
material that they will be interested in, based on each user's history of engagement on 
that platform. (Shorenstein Center, 2018) 


Computer-based automated decision-making, inspired by human-like intelligence, 
Automated decisions might be directly implemented {e.g., in rabotics) or suggested to a 
human Gecision-maker (e.g., product recommendations in online shopping). Al often 
incorporates machine learning {ML}, in which predictions are based on patterns 
“earned” from existing data. (USAID, 2019) Also see Machine learning. 


Organized activity that is intended to creale a false impression of a widespread, 
spuntaneously arising, grassroots movernent in support of or in opposition to something 
(such as a political policy) but that is initiated and controlled by a concealed group or 
organization {such as a corporation). 


This effect is when beliefs are reinforced in ihe very attempt to debunk therm. 


Describes aggressive and illicit strategies used to artificially increase a website's 
position within a search engine's results: for example, changing the content of a 
website after ithas been ranked. These practices generally violate the given search 
engine's terms of service as they drive traffic to a website at the expense of the user's 
experience, (First Draft) 


Bots are social media accounts that are operated entirely by computer programs and 
are designed to generate posts and/or engage with content on a particular platform. In 
disinformation campaigns, bots can be used to draw attention to misleading narratives, 
to hijack platforms’ trending lists, and to create the illusion of public aiseussion and 
support. {Shorenstein Center, 2018} Also see Sock puppet. 


An audio or video manipulations created with cheaper, more accessible software (or 
none at all}, They may be subtle, such as slowing down the speed at which a video is 
played, making it appear that the speaker's speech is slurred, or altering the 
background or an otherwise insignificant aspect of a picture. 


Web content with misleading or sensationalist headlines that entices readers to click 
through to the full story, which is generally a disappointment. Clickbait’s goal is usually 
to generate page views and advertising revenue. (Haotsuite, 2019) 


Use of algorithms, automation, and human curation te purposefully distribute 
misleading information aver social media networks.’ (Woolley & Howard, 2017) 


A website or company that creales low-quality content aimed at improving its search 
engine rankings. Also known as a content mill or factory, its main purpose is to 
maximize page views and revenue generated by advertising on those pages while 
minimizing the costs and time needed to create the centent.*3* 


The process by which content is moderated on digita| media platforms and users are 
warned'hincked arcarainn +n niihiir tarme at cawice anreamants and niatiarm 


es a ee ee ey ee ee OO Be ae, ee re eee Oe ee ee ee ee i oT ee 


“community standards." (Data & Society, 2019) 


Coordinated Inauthentic | A term coined by Facebook in 2016 to describe the operation of running fake accounts 

Behavior and pages on an online social platform in order to influence discourse among users. 

Cyber Troops Government or politica! party actors tasked with the use of social media to manipulate 
public opinion online.*** 

Dangerous Speech Any form of expression (speech, text or imaged) that can increase the risk that its 
audience will condone or participate in violence against members of another group. 
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Debunking Publicly uncovering false information that is disseminated in order to iniluence or rather 
manipulate the whole of society or at least its major parts. 

Deep Fakes Deepfakes are videos, images, and audio generated using artificial intelligence to 


Digital Literacy 


Digital Media 


Digital Security 


Disinformation 


Doxing 


Echo Chamber 


Fact Checking 


Filter Bubble 


Flooding 


Gaslighting 


Hate Speech 


synthetically render realistic depictions of speech and action,* 


The ability to “access, manage, understand, integrate, communicate, evaluate and 
create information safely and appropriately through digital devices and networked 
technologies for participation in economic and social life. This may include 
competencies that are variously referred to as computer literacy, information and 
communication technology (ICT) literacy, information literacy, and media literacy.” 
Digital literacy includes doth hard skills related to the use of hardware or software and 
digital soft skills related to the use of digilal media and information. (USAID, 2019) 


Digital media includes the user-generated content and underlying software applications 
that make up internet-based communication tools, such as websites, mabile 
applicalions, news aggregators, socia! media platforms, search engines, and 
messaging/chat services, (USAID, 2019) 


The practice of understanding one's digital footprint, identifying localized risks to 
information systems and taking reasonabie steps to protect one’s Owned assets from 
loss or capture. (USAID, 2019) 


Disinformation is false information that is deliberately created or disseminated with the 
express purpose to cause harm. Producers of disinformation typically have political, 
financial, psychological, or social motivations, (Shoranstein Canter, 2078) 


Doxing, or doxxing, is the internet-based practice of researching and publicly 
broadcasting private or identilying information about an individual or organization. The 
methods employed to acquire this information include searching publicly available 
databases and social media websites, hacking, and sacial engineering. 


An environment or social space where individuals are interacting with ideas and beliefs 
similar to their own, Existing ideas are thus reinforced. and they avoid being challenged 
by alternative ideas.7% 


Fact-checking (in the context af information disorder) is the pracess of determining the 
truthfulness and accuracy of official, published information such as politicians’ 
statements and news reports. (Shorenstein Center, 2018) 


A situation thal arises by virtue of an algorithmic filler, where internet and social media 
users interact with material that supports their own beliefs and ideas, and in tum 
algorithms continue to provide the user with similar content=? 


Flooding is spamming with unsolicited or misguided junk mail, chal, or social media 
messages such as advertising, brochures, or fake solicitations, 


A technique of deception and psychological manipulation practiced by a deceiver, or 
“gaslighter,” on victims aver an extended period. Its effect is to gradually undermine the 
victims’ confidence in their own ability to distinguish truth from falsehood, right from 
wrong, or reality from appearance, thereby rendering them pathologically dependent on 
the gaslighter.** 


The use of Speech to make direct attacks against an individual or a group of people 


FL-2023-00013 
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Internet Freedom 
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Machine Learning 


Malinformation 


Manufactured 
Amplification 
Media literacy 


Meme 


Message Monitoring 


Microtargeting 


Misinformation 


Natural Language 
Processing 


Open-Source 
Intelligence (OSINT) 


Persona 
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based on a Series of protected characteristics, such as race, ethnicity, nationality, 
religion, sex, sexual orientation, gender idantity, and physical or manta! ability. (USAID, 
2019) 


Individuals or organizations working to mislead others about who !hey are and whal 
they are doing.2 


A condition in which truth and facts coexist In a milieu of misinformation and 
disinformalion—conspiracy theories, lies, propaganda, and half-truths. 


The U.S. Government conceptualizes internet freedom as the online exercise of human 
rights and fundamental freedoms regardless of frontiers or medium. The same rights 
that people have offline must also be protected online—in particular, freedom of 
expression, which is applicable regardiess of frontiers and through any mecia of one's 
cheice, (USAID, 2019} 


The development and application by governments, the private sector, and civil society, 
in their respective roles, of shared principles, norms, rules, dacision-making 
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procedures, and programs that shape the evolution and use of the internet. (United 
Nations, 2017) 


A set of methods fer using computers to recognize patterns in data and make future 
predictions based on these patterns. Machine learning can be “supervised” or 
“unsupervised,” depending on the level of human oversight. (USAID, 2019) Also sae 
Artificial intelligence. 


Deliberate publication of private information for personal or private interest, as well as 
the deliberate manipulation of genuine content. Note that these information are based 
on reality but are used and disseminated to cause harm. (Wardle & Derakhshan, 2017) 


Boosting the reach or spread of information through artificial means. **" 


The ability to methodically consider and reflect on the meaning and source of a post or 
news article. 


An idea or behavior thal spreads from person to person lhroughoul a culture by 
propagating rapidly and changing over time. The term is now Used most frequenitly to 
describe captioned photes or GIFs thal spread online; the most effective are humorous 
or critical of society. (Shorenstein Center, 2018) 


Message monitoring analyzes the tropes, narratives, or specific messages thal a bad 
actor is pulting forward. In this way, it monitors platlorms to lock at the key messages 
that extremist or conspiracy groups are putting oul to see if there are specilic 
messages that they are repeating in talking paints. 


Directing tailored advenisements, political messages, etc. at people based on detailed 
information about them (such as what they buy, watch, or respond to on a website); 
targeting small groups of people for highly specific advertisements or messages." 


Misinformation is information that is false, bul not intended to cause harm. For 
example, individuals who da not know a piece of infarmation is false may spread it on 
social média in an attempt to be helpful. (Shorenstein Center, 2018) 


The relationship between computers ang human language content. It refers to speech 
analysis in both audible speech, as well as text of a language. NLP systems caplure 
meaning from an input of words (sentences, paragraphs, pages, ets). 


The multi-mstnod approach of collecting and analyzing free, publicly available 
information and cross-referencing it against other public sources, *** 


The creation of a representative user based on available data and user interviews. 
Though the personal details of the parsona may be fictional, the information used to 
create the user type is not. Personas can help bring a target audience to life. 
(Usability.gov, 2079} 


Pink Slime Journalism 


Platform Related 


Prebunking 


Propaganda 


Redirecting 


Satire 
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A \ow-cost way of distributing thousands of algorithmically generated news stories, 
often with political bias. 


A social platform is a web-based technology that enables the development, 
deployment, and management of social media solutions and services. Ii provides the 
ability to create social media websites and services with complete social media network 
functonality. (Examples include Facebook, Linkedin, Twitter, Snapchal, Pinterest, 
Instagram, WhatsApp, TikTok, and others.) Some disinformation is purposefully spread 
through algorithms that target specific audiences or inauthentic actors who gain a 
following in social media. Others are an unintended consequence of the way we share 
information or gain followers on sacia| media platforms, such as the Echo chamber and 
the Filter bubble. 


An olfensive strategy that refers to anticipating what disinformation is likely to be 
repeated by politicians. pundits. and provocateurs during Key events and having 
already prepared a response based on past fact checks.**9 


True or false information spread lo persuade an audience bul often has a politica! 
connotation and is often connected to information produced by governments. 


Sending a user to a different site or reference that can Serve to debunk or offer context 
to information presemed in social media or on a website, 


Satire is writing that uses literary devices such as ridicule and irony to criticize elements 
of society. Salire can become misinformation if audiences misinterpret il as fact. 
(Shorenstein Center, 2018} 
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Trolling 
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A means ol allaining interpersonal information and social intelligence from social media 
to understand how relationships are formed and influence the way we listen to and 
communicate with one another.24 


The process of identifying and determining what is being said about an issue, an 
individual, or a group through different socia! and online channels, |t is used also by 
businesses to protect and enhance the reputation of their brands and products. The 
method uses bolts to craw! the internet and index messages based on a set of 
keywords and phrases.**8 


A sock puppet is an online account that uses a false identhy designed specifically to 
deceive, Sock puppets are used on social platforms to inflate account's foliower 
numbers and to spread or amplity false informaticn to a mass audience, Often 
confused with a meat puppel, which is another actual individual! using a false \dentity 
for the same purpose. (Shorenstein Center, 2018) Also see Bot. 


A troll farm is a group of individuals engaging In trolling or bot-like promotion of 
narratives in a coordinated fashion, (Shorenstein Center, 2018) 


The act of deliberately posting offensive or inflammatory centent to an online 
community with the intent of provoking readers or disrupting conversation. The term 
“trail” is mast often used to refer to any person harassing or insulting others online. 


Verilication is the process of determining the authenticity of Information posted by 
unofficial sources online, particularly visual media. (Shorenstein Center, 2018) 


The measurement, collection, analysis and reporting of internet data for purposes of 
understanding and optimizing web usage. (Usability.gov, 2018) 
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ANNEX 2: TYPES OF MISINFORMATION & DISINFORMATION 


The following examples were provided by First Draft News [hitps://firstdraftnews.org) to help 
illustrate and provide examples of the various types of misinformation and disinformation. 


Fabricated content 


htips./www.vice.comen in/article/iqedib/the-first-use-ot-deeotakes-in-indian-election-by-bj 


Indian politician uses deepfake to show himself giving a speech in a different language. 


False Connection 


https:/Awww. youlube.com/watch ?v—QillhGzhW7o 
The title of the video plays on anti-Chinese sentiment that is prevalent in Latin America to 
get pecplie to click on the video and share. A textbook example of False Connection. 


False context 


https://twitter, com/AFPFactCheck/’status/122 1 73207588510106 


Video allegecly from Wuhan province where coronavirus originated is really from Indonesia. 


Imposter content 


Fake screenshot that shows Newsweek article about Iran air strikes. Snows side-by-side 
comparisons of real/fake screens. 


Satire or parody 


ttips://facitcheck.afp.com/australian-cou uarantined-onboard-ciamond- 
reveal-wine-drone-delivery-story-was 
The "news" aboul an Australian couple on cruise ship ordering wine via drone was 
debunked. The couple admitted that it was a joke posi on Facebook for their friends. 


Manipulated content 


httos://Iwitter com/amescracknell/status/125439545 70333798439 ?s=21 


Daily Mali edited a photo to make two people in a garden to appear closer than they really 
are. 


Misleading content 


htips:/Awww.bbc.com/news/blogs-trending-51020564 
BBC Trending investigates cases of disinformation on Australian bushfires maps on social 
media. 
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ANNEX 3: EMERGING SOLUTIONS 


Fact-Checking Initiatives 


Atrica Check is a nonprofit organization established in 2012 to promote accuracy in public debate and the 
media in Africa. Devised by the nonprofit media development arm of the international news agency AFP, 
Africa Check is an independent organization with offices in Jonannesburg, Nairobi, Lagos, and Dakar. Africa 
Check produces reporis in English and French. testing clairng made by public figures. instilutions and the 
media against the best available evidence. They have fact-checked more than 1,500 claims on topics from 
crime and race in South Africa to population numbers in Nigena and fake nealth cures in various African 
countries. 


Chequeado |s the main project of the La Voz Publica Foundation. They are a nonpartisan and nonprofit digital 
medium dedicated to the verification of public discourse, the fight against disinformation, the cromotion of 
access to information and the opening of data. Chequeado has been online since October 2019 and was the 
first site in Latin America dedicated to speech verification; it is among the top 19 fact-checking organizations in 
the world. 


iRasKAlKavanje (Serbia) is a |eading source for debunking disinformation in Serbia. With more than nalf a 
million monthly readers, it has been fact-checking media coverage of the COVID-19 pandemic, as well as 
covering the government's response to the crisis. |ts posts have been regularly republished by the leading 
Serbian daily newspapers and portals. 


PopUp Newsroom (global—some work has been in Mexico and Sweden) is a concept focused on 
collaboration between competing newsrooms in order to drive innovation, especially as it relates to the anline 
disinformation sphere."* In Mexico, the organization helped launch Verificade, with more than 90 partners 
working to address disinformation around the 2018 elections. 


TruthBuzz (qlobal—with fellows and partners |n Brazil, India, Indonesia. Nigeria, and U.S.) Is an initiative 
sponsored by the International Center for Journalists to nelp reporters utilize compelling storytelling methods 
that improve the reach and impact of fact-checking and help audiences learn to identify the true from the 
false.<4" TruthBuzz fellows work logether with a newsroorn and receive training from First Draft News. One 
fellow's project supported Tempo.co, an Indonesian investigative reporling ouilet, to reach a younger audience 
and begin introducing fact-checking approaches.*"* 


Ukraine has developed some significant fact-checking initiatives. VoxUkraine Uses a scientific analysis 
meinod to assess major economic and political processes and decisions in Ukraine. Among others, a key 
project by the Vox team is VoxCheck, 2 tact-checking service that identifies disinformation narratives being 
spread online. TEXTY.org is a Ukrainian nonprofit data analysis group that fact-checks and combats 
disinformation 


What’s Crap on WhatsApp (Africa) combats misinformation and disinformation on WhatsApp by utilizing the 
app itself to spread 2 fact-checking podcast. The show encourages users to send misinformation and 
disinformation to the organization's WhatsApp number and then the show producers create shorl podcast 
episodes thal debunk the rumors and send them lo their subscribers, who can easily forward them along to 
the groups in which the misinformation and disinformation spread in the first place.*** 
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Examples of Elections-Focused Programming 


ISFED's Fact-a-lyzer was created by the International Society for Fair Elections and Democracy, which was 
established for the 2018 presidential election in Georgia. Fact-a-lyzer is a pilot social media moniloring lool 
used for the election. The tool's software aggregated and monitored the Facebook content on public pages for 
political actors and groups, assigning tags io the posts. This dala was then used lo identify and analyze 
content trends 2° 


iIFES’s Social Media, Disinformation and Electoral Integrity examines the challenges disinformation 
presents to electoral integrity and the responses electoral management bodies anc international 
nongavernmental organizations can take to mitigate threats. *5' 


NDI's Disinformation and Electoral Integrity: A Guidance Document for NDI Elections Programs 


describes the National Democratic Institute's programmatic approaches to mitigating, exposing, and 
countering disinformation in the electoral context. The document stresses the importance of using open 
slaction data to deter disinformation and advocacy to counter it.“"" 


Supporting Democracy’s Guide for Civil Society on Monitoring Social Media During Elections provides 


an in-depth explanation of social media's rola in elections, its impact on the electoral process, methodological 
approaches to monitoring ff, data collection and analysis tool, and approaches for making an impact with 
social media monitoring.** 


Examples of Coalitions 


EUvsDisinfo is an EU-spearheaded project started in 2015 te “increase public awareness and understanding 
of the Kremlin's disinformation operations, and to help citizens in Europe and beyond develop resistance to 
digital disinformation and media manipulation," EUvsDisinto has hands in three major areas. First, it 
conducts data analytics of media spaces to identify and publicize disinformation campaigns started by the 
Kremlin or pro-Kremlin media outlets; the data are archived in an open-source, dedicated database. Second, 
the project publishes summaries, articles, and reports both within Ihe research community and for wider 
general readership. Third, it offers training resources for governments, media cutlets, universities, and civil 
sociaty organizations. 


The Atlantic Council is a “nonpartisan organization that galvanizes US leadership and engagement in the 
world, with allies and partners, to shape solutions to global challenges.”*** Among the numerous capacities 
through which Atlantic Council conducts international work, their recently published Democratic Defense 
Against Disinformation 2.0 provides a current snapshot of global! disinformation campaigns at wark, proposed 
solutions, progress made, and criticisms and recommendations made to the U.S. executive and judiciary 
branches regarding urgent steps needed in the path toward a healthier information ecosystem, 
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Resources for Legal and Policy Approaches 


Poynter's A Guide to Anti-misinformation Actions Around the World has a regularly updated mapping by 
the Poynter Institute of both Ihe positive and negative actions thal governments have carried oul to combat 
misinformation ,?** 


UNESCO's Balancing Act: Countering Digital Disinformation While Respecting Freedom of Expression 
is unique in its global scale and comprehensiveness, but it is also highly action-oriented, with a suite of sector- 


spectiic actionable recommendations and a 23-point framework to test disinformation responses. 


~———_"." ot "as Fart ‘ee =, 7 hee 


OxTEC's A Report of Anti-Disinformation Initiatives is a 2019 report by the Oxford Technology and 
Elections Commissian (OxTEC) that analyzes fake news landscapes around the world, the gavernmental 
measures to address disinformation, and the geopolitica! contexts facing each example. The report features 
examples from 19 countries In four continents.?>” 


Examples of Counter-Disinformation Campaigns 


A Counter-Disinformation System That Works details the formula Debunk.eu and its pariners are using to 


counter disinformation in Lithuania. Using a combination of “geeks,” or IT and Al experts Geveloping algorithms to 
detect false claims: “elves,” or volunteers who research and debunk false stories: and journalists, who publish 
finished stories about the debunked claims, Lithuanian anti-disinformation activists claim to have established a 
successful, fully integrated system,?°° 


Russia's Disinformation Activities and Counter-Measures: Lessons from Georgia is a report from think-tank 
European Values about the main lessons learned from the light agains! pro-Kremlin disinformation in Georgia ** 


Examples of Local Journalism Support 


Internews is aimed at building lasting change by ensuring people nave access to quality. local information. To do 
$0, Internews works with local partners to grow sustainable organizations and offers capacity-bullaing programs for 
media professions, human rights activists. and information entrepreneurs.°° 


IREX promotes “vibrant information and media systems.” IREX supports journalism and media organizations 
through trainings on reporting, media law, media satety, and digita! security. [REX also provides additiona! support to 
consumers via media literacy programs, training citizen journalists, and diversifying and distributing television 
content.* 


International Center for Journalists (ICFJ) seeks to build the expertise and storytelling skills of journalists 


around the world. IGFJ focuses on five key areas: news innovation. investigative reporting, global exchange 
programs, specialty journalism, and diversity promotion.*** 
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Examples of Media Literacy 


Digital Security Project seeks to provide data on the intersection of politics and socia! media. Its indicators cover 
topics including online censorship. polarization, misinformation campaigns, coordinated inlormation operations and 
foreign intiuence in and monitoring of domestic politics. It uses the Varieties of Democracy (V-Dem) framework, also 
used by USAID in Journey to Self-Reliance (JSR) metrics, to assess various digital issues inciuding misinformation. 


IREX's Learn to Discern (L2D) is a worldwide media literacy training project fer all ages that focuses on 
developing healthy information engagement habits and increasing the |ocal demand for quality information. Ils 
approach and curriculum are designed to meet the current needs of media consumers, adapting to the loca! context. 
L2D has been used in Ukraine, Serbia, Tunisia, Jordan, Indonesia, and the United States to address challenges 
stemming from misinformation, disinformation, propaganda, anc influence campaigns. 7% 


NewsWise is a free cross-curricular news literacy project [or 9- to 11-year-old children across the United Kingdom, 
supparted by the Guardian Foundation, National Literacy Trust, the PSHE Association, and Google. kt features 
resources—inciuding guides, webinars, and activities—for teachers and tamilies.** 


Examples of Public Awareness Campaigns 


#ThinkB4UClick (Think Before You Click} is a campaign by #defyhatenow to raise awareness about the dangers of 
misinformation, fake news, and hale speech in South Sudan. ll seeks to educate the public on these terms and 
expiain how their individual actions can mitigate the issues to create safe online and offline spaces for healthy and 
informed discussions. 


Elves vs. Trolls is an informal internet army of Lithuanians trying to counter what they describe as hate speech and 
pro-Russia propaganda, 


The War on Pineapple, promoted by the U.S, Cybersecurity and Infrastructure Agency (CISA), uses the concept of 
pineapple on pizza to promote understanding of foreign interference in live steps: targeting divisive issues, moving 
accounts into place, amplifying and distorting the conversatian, making the mainstream, anc taking the conversation 
into the real wor!d. 
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ANNEX 4: PASSIVE & ACTIVE DRIVERS OF DISINFORMATION 


In Demand for deceit: How the way we think drive disinformation, Samuel Woolley and Katie 
Josetf compile a list of cognitive active and passive drivers that explain ways individuals can 
be manipulated into believing false content. These “cognitive drivers of consumption. 
acceptance, and sharing of disinformation” are broken into passive and active categories. 


Passive Drivers 


Belief Perseverance 
Effect 


Familiarity Effect 


Misintormation Effect 


Continued influence of initial conclusions {sometimes based on false, nove! 
information) on decision-making and individual beliefs. 


Information which is repeated or delivered in a manner consistent with past 
experience (jor example, in a frequently heard accent) is often deemed more 
credible. 


False information suggested to individuals after the fact can influence their 
perception, especially as time passes and the memory weakens. 


Priming Shaping an individual's perceptions and behavior through exposure to 
subconscious stimnull. 

Repeat Exposure Individuals may respond more positively to stimuli that they have seen frequently 
than to stimull they have seen anly a few times; persists even when exposure is 
subliminal, and individuals are unaware that they have seen a stimulus. 

Truth Bias The default assumption that information is credible. 

Virality and Heightened — Information which evokes fear, disqust, awe, anger, or anxiely may be much 

Emotion more likely to be spread by individuals over social media. 


Active Drivers 


Bandwagon Effect 
Contirmation Bias 


Consensus Bias 
Disconfirmation Bias 


Directionally Motivated 
Reasoning 


In-group favoritism 


Prior Attitude Effect 


Preterence Falsification 


The tendency of individuals to be more likely to adopt beliefs thal they believe 
are common among others. 


Suggests that individuals seek out information that agrees with their preexisting 
beliets. 


The tendency to believe intormation that is perceived as consensus. 


Suggests that people actively reason against information which conflicts with 
preexisting beliefs. 


The desire to reach a specific conclusion, and thus to lend more credibility to 
information favoring that conclusion. 


The tendency to favor one’s “in-group” (€.g.. race, gender, sexual orientation, 
religious preference, partisan affiliation, geographic tocation, etc.) over one’s out- 


group 


Occurs when individuals express preferences (6.q.. favored politician or policy) in 
response to perceived societal pressures and do not communicate their true 
opinion. 


Suggests that people regard information that supports their beliefs (“pro- 
attitudinal information") as more legitimate than counter-attitudinal information 
{sometimes called the priar attitude effect). 


Source: Woolley, S, & Joseff, K. Demand for deceit: How the way we think drives 
disinformation. Working paper. National Endowment for Democracy. 


httos://www.n 


_org/wp-content/uploads/202 


1/Demand-tor-Deceit._pdf 
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ANNEX 5: QUICK RESOURCES FOR PLANNING A 
DISINFORMATION STRATEGY 


1. Disinformation and Elections 


e NDI Disinformation ana Electoral Integrity 
e IFES Social Media. Disinformation and Electoral Integrity 


e Protecting Electoral Integrity in the Digital Age 


2. Disinformation Research Institutions 


e Harvard Kennecy School/Misinformation Review 
e First Draft News 

© Stanford Cyber Policy Center 

¢ Atlantic Council's Digita! Disinformation Primer 


3. Disinformation and Civil Society 


e ComProp Navigator 
@ Interaction: disinformation toolkit fer civil society 


4. USG Resources for Analytics 


e Giobal Engagement Center's DisinfoCloud 
e Global Engagement Center’s Counter-Disinformation Dispatches 


5. USG Policy/Strategy 


e National Security Strategy, December 2017 Pillar lilt Preserve peace through strength’- 
Information Statecraft — “activate local network: local voices are most compelling and 
effective in ideological competitions’ 


® DoS/USAID Joint Strategic Plan FY 2018-2022 Strategic Objective 1.4: Increase 
capacity and strengthen resilience of our partners and allies to deter aggression, 
coercion and malign influence by stale and non-state actors 


e USAID Countering Malign Kremlin Influence Objective 2; Resist tne manipulation of 
information 


e National Defense Authorization Act 2016, 2017, 2020 
e USG Organizations engaged on disinformation: 


e USG Organizations: Historical—The US. Information Agency 
e DoS/Global Engagement Center (GEC} 


ia. ea: a Se’ A Brr.-~i 8s 8 Bue: E2Gc) Pee es ey ee es es 


8 ¥VOOMPA oOClel VWiEUid FPIeseiee 
e U.S. Agency for Global Media (USAGM) 
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ANNEX 6: SECTION-BY-SECTION RESOURCES 


A. INTRODUCTION—SUPPLEMENTARY RESOQURCES 


The Wilson Center, the Carnegie Corpeoration of New York, and the University of Washington 
hasted a discussion on disinformation campaigns and octential ways to combal them. This 
video captures key aspecis of tne issues presented in the Primer. Panelists provided a 
historical overview of disinformation campaigns, assessed currem patterns in disinformation, 
and discussed the potential challenges that lie ahead, Key concepts covered included: 
Disinformation Defined, Goa! of Disinformation, Russian Disinformation, RT, Sputnik and 
Bots, and Identifying Disinformation. 


campaigns 


ComProp Navigator is an online resource guide for CSOs to learn more about digital 
disinformation tapics and address their concerns; il is curated by civil society practitioners 
and the Project on Computational Propaganda.*** 


https://navigator.cii.ox.ac.uk 


B,. PART TWO: UNDERSTANDING INFORMATION DISORDER—SUPPLEMENTARY RESOURCES 


Dean Jackson for National Endowment for Democracy’s |nternational Forum Democratic 
Studies created three issue briefs to offer insights into various part of mis/disinformation: 


e (ssue Brief: Distinguishing Disinformation from Propaganda, Misinformation, and "Fake 
News” |s helpful on defining disinformation. 
e Issue Brief: How Disinformation Impacts Politics and Publics 


e (issue Brief: The ‘Demand Side’ of the Disinformation Crisis is helpful on how psychology 
and cognitive biases help perpetuate the reach and impact of disinformation. 


For a look at how Finland has taken on mis/disinformation: 
* Media Lileracy in Finland Sets the Bar: Web Extra: Finnish Kids Got Education | Full 
Frontal! on TBS 


e Media literacy in Finland is the media literacy policy and the national media education 
policy document, published by the Ministry of Education and Culture in 2019. 


For some insights into China: 


@ The Hoover Institution has a project called China's Globa! Sharp Power. which examines 
China's role in “digital authoritarianism,” among cther topics. 


— Alen rann tha avhaicotiean fOambattinna and Matnatina Mhinnon Drananansia ann 


~~ FV PRCA LEI BA EAR OE RPP PLCS bw Cor ike bie ealtl ba | A ee | bel hata ~ beans ee 
Disinformation: A Case Study of Taiwan's 2020 Elections by Aaron Huang of the Belfer 
Center at Harvard Kennedy School. 


To learn more on how algorithms amplify disinformation: 


e What is an algorithm? in The Economist, August 30, 2017 


e Misinformation has created a now world disorder: Our willingness to snare content 
without thinking is exploited to spread disinformation by Claire Wardle in Scientific 
American, September 1, 2079. 
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@ How misinformation spreads on social media—And what to do about it by Chris 
Meserole, Brookings Institution, May 9. 2018. 


On how disinformation spreads across online platforms/applications: 


e WhatsApp as a tool for fear and intimication in Lebanon's protests. by Emily Lewis in 
Coda. November 12, 2019. 


e Disinformation trom China floods Taiwan's most popular messaging app, by Nithin Coca 
in Coda, October 7, 2020 


C. PART FOUR: WHAT SOCIAL FACTORS CONTRIBUTE TO DISINFORMATION? 
Resources for Media Monitoring: 


@ Bakamo.Social is a strategic social listening consultancy that uses technology and 
human understanding to find meaning in the millions of conversations that take place 
online every day. hittps://www bakamosocial.com/ 


@ Fast Stratcom Task Force (FU) was set up to address Russia’s ongoing disinformation 
campaigns. In March 2015, the European Council lasked the High Representalive in 
cooperation with EU institutions and Member States to submit an action plan on strategic 
communication, https://eeas.curopa.cu/headquarers/headquarters-homepage/2116/- 
questions-and-answers-aboul-the-east-straicom-ltask-force en 


e KremlinVVatch is a strategic program of the European Values Center for Security Policy, 
which aims to expose and confront instruments of Russian influence and disinformation 
operations focused against Western democracies. https://www.kremlinwatch.eu/ 


e Memo 98 is 4 Slovakia-based specialist media monitoring organization. witn extensive 
experience of delivery media analyses on benalf of international institutions as well as 
technical assistance to civil society groups. It offers specializea media monitoring 
services in the area of disinformation. 


¢ Moonshot Consulting seeks to find audiences vulnerable to violent extremist and false 
messaging, works to better understane them, and then builds an evidence base to 
deliver campaigns and interventions to make information safer. 
htip://moonshoteve.com/work/ 


e Researcners from the University of Notre Dame are using artificial intelligence to develop 
an early warning system that will identify manipulated images, deepfake videos. and 
disinformation online. The project is an effort to combat the rise of coordinated social 
media campaigns to incite violence. sow discord, and threaten the integrily of democratic 


BlIe®ChONS. NUPs NewS NC SOU NEWS TeSeadfcnerS-UeVeRlop-eally-Wwe SYSLeM-.O-T/Qrit- 
disinformation-online/ 


Examples of open-source intelligence (OSINT): 


e “How to Conduct an Open-Source Investigalion, According to the Founder of Bellingcat” 
is an article about Eliot Higgins, founder of the open-source investigation website 
Bellingcat, and his workshops to teach journalists, NGOs, government agencies. and 
other interested parties how to use OSINT for their investigations. Bellingcat provides an 
online investigation toolkit that is updated regularly and provides open-source and free 
software. = 


e First Draft Basic Toolkil also provices links to open-source and free software of use to 
newsrooms for newsgathering, verification, and responsible reporting. 


e Atlantic Council's Digita! Forensic Research Lab (DFRLab) uses open-source research 
to expose and expiain disinformation; tne DFRLab seeks to build “the world’s leading 
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hub of digital forensics analysts (#DigitalSher|ocks},” promoting objective truth, protecting 
democratic institutions and norms, and forging greater digital resilience worldwide.**’ 


e “Civil Society Tracks Trolls and Fakes, Prompts Facedook Action in Moldova” is an 
article describing Trolless, a platform that enabled Moldovan users to report fake profiles, 
troll accounts, and suspicious activity and material. Once reported, the Trolless leam 
would investigate and publish their findings. providing verification or more information 
about the suspected accounts and content. 


D. Part Five: WHAT ARE SOME ANTICIPATED CHALLENGES? 


To learn more about some of the technologies mentioned in this section: 


® The Hamilton 2.0 dashboard, a project of the Alliance for Securing Democracy al ihe 
German Marshall Fund of the United Slates, provides a summary analysis of the 
narratives and topics promoted by Russian, Chinese, and lranian government ofticials 
and state-funded media on Twitter, YouTube. state-sponsored news weodsites. and via 
official diplomatic statements at the United Nations. 
https ://securinggemocracy.gmfus.org/hamilton-dashboard/ 

e Artificial Intelligence (Al)-Generated Propaganda lab OpenAl has already released a 


beta version of GPT-3, a long-form text generator that works by taking text input and 
predicting wnat should follow. https://opena|.com/blog/openai-api/ 


E. PART SIX: WHAT ARE SOME EMERGING SOLUTIONS FOR DISINFGRMATION? 
On debunking and discrediting: 


e lhe Global Engagement Center (GEC) at the U.S. Department of State recommends a 
combined debunking and discrediting approach, which is explained in GEC Counter. 
Disinformation Dispatches #2: Three Ways to Counter Disinformation and GEC Counter- 
Disinformation Dispaicnes #4: What Works in Debunking, 
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ANNEX 7: WHAT TO READ & WATCH 


Select key books to help orient your Knowledge and understanding ot disinformation 
Studies 


Algorithms of Oppression: How Search Engines Reinforce Racism by Safiya Umoja 
Noble 


Antisocial Media: How Facebook Disconnects Us and Undermines Democracy by Siva 
Vaidhyanathan 


Cammunication Power by Manuel Castells 


Computational! Propaganda: Political Parties, Politicians, and Political Manipulation ori 
Social Media by Samuel C. Woolley and Philip N. Howard (Editors) 


How Propaganda Works by Jason Stanley 


How to Lose the Information War: Russia, Fake News, and the Future of Conflict by Nina 
Jankowicz 


Lie Machines: How to Save Democracy From Troi Armies, Deceitful Robots, Junk News 
Operations, and Poiltical Operatives by Philip Howard 


Mind Over Media: Propaganda Education for a Digital Age by Renee Hobbs and Douglas 
Rushkoff 


Nothing is True and Everyihing !s Pessibie: The Surreal Heart of the New Russia The 
Surreal! Heart of the New Aussia by Peter Pomerantsev 


e This Is Not Propaganda: Adveniures in the War Against Reality Adventures in the War 
Against Reality by Peter Pomerantsev 


e Twitter and Tear Gas: The Power and Fragility of Networked Protest by Zeynep Tufekci 


Key podcasts of interest 


e All Things Policy, Episode 354; Ordering the Information Disorder: 
https://player.{m/senes/allt-things-policy/ep-354-ordering-the-information-disorder 


e CSIS, Confronting the Problem of Faxe News in Africa: 
https://www.csis.org/events/confronting-problem-fake-news-africa 


e Democracy in Danger; produced by the Deliberative Media Lab with support from the 
UVA Democracy Initiative and the College of Arts and Sciences: 
https://medialab.virginia.edu/democracyindanger 


¢ Demystifying Media at the University of Oregon, Episode 39: Fighting a New Era of 


Disinformation with Claire Wardie: hitps:/www.stitcher.com/podcast/demystifying-media- 
podcast 


e The Disinformation Age: hitps://www.mikehind.co.uk 
® Interpret; Health Misinformation & Polio in Pakistan with Carlotta Doito: 


https://www.buzzsprout.com/73921 7/4387205-health-misinformation-polio-in-pakistan- 
with-carlotta-dolto 


e NED's Power 3.0; blog posts and podcast episodes related to media and technology: 
https://www. powerapointd. org/category/media-information-technology/ 
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@ Wew York Public Radio, On the Media; Ukraine's Remedy for Fake News: News About 
Fake News: hitosv/Avww wnycstudios.org/podcasis/otm/seqments/ukraine-remedy-fake- 
news-mcre-news 


# The Nordic Co-operation, The Foreign Desk; The Threais to Democracy: 
e https://www.norden.org/en/information/foreicn-desk-threats-democracy 


e NPR, Rough Translation; Ukraine vs. Fake News: 
hitps://www.nor.org/2017/10/17/5444588938/ukraine-vs-fake-newsPodcast Brunch Club: 
Disinformation and Fake News; January 2020 Listening List: 
https://podeastbrunchelub.com/fakenews/ 


e The Poynter Institute; fs fact-checking the antidote to misinformation? 
hitos://www.spreaker.com/user/newsu/m\sinformed-episode- 
3?utm_medium=widget&utm_source=user%o3A 1062841 9&utm_term=episode_titieRecod 
e Decode, Episode 524; Phil Howard and Emily Bell: Disinformation in 2020, from 
‘Plandemic” to Bill Gates to "Obamagate’? white US-fecused, this podcast contains very 
usetul information and explanations thal will be helpful to teaching and understanding the 
disinformation challenge 


Documentaries and Useful YouTube Videos 


e After Truth: Disinformation and the Cost of Fake News: 


lnbewvesfiananss A RA Rn [AA a een teavianeiafeny tuirskh Ani aAstarer-ebiann ant tha anAanse mt tala API 


BURR MEE ERE PP eR APL ERE a A NN PI et 
e Al Jazeera—tndia: Fake News and Agiiprop: 


https:/Awww. youtube.com/watch ?v=SOLGwL6rMPk&list=PLZGHKhBISy I wQ4uKHdPDjgh 
nAap_himdh&index=39 

e Al Jazeera—How Fake News Couid Shape Kenya's Election: 
hitps:/Awww. youlube.com/watch ?v=Pz65C9fQpdM &list=PLZGHKb8 9v TwQ4uKHoPDjgh 
nAap himodh&index=13 

e Aj Jazeera—tnside Story: Should Social Media Be Reguiaied? 
hitps www, youtube. com/watch ?¥=- 
QaxVetsulcg&list=_PLZGHKb8ISvV TWO4uUKHdPDiahnAap nimdh&index=56 

® Fact or Friction: Reporting an Hong Kong's Protests: 
https://www. youtube.com/watch 7v=blIUWA7NkIT U&list=PLZGHKb8i9v TwO4duKHdPDjchn 
Aap himdh&index=53 

e MIT's Moon Disaster: https://‘moondisaster.org 

e New York Times’ Operation Infektion: 
https.//www,nytimes.com/2018/1 1/1 2/opinion/russia-meddling-disinformation-fake-news- 
elections. html 


e TED—How Can We Protect in the Age of Misinformation: Sinan Aral: 
hitps.//www.youtube.com/watch ?v=-70RAKULei4 


e TED Global—How to Seek Truth in an Era of Fake News: Christiane Amanpour: 
https:/‘www.ted.com/talks/christiane amanpour how to seek truth in the era of fake 
_news?referrer=piaylist-tne_value_of_skepticism 


e A Thousand Cuts: hitps:/www.athousandcuts. film 


e Trust Me Documentary: 
https://www.trustmedocumentary.com/?gclid-C) wKCAjww5r8BRBSEiwArcckCSU5SUTNY 
NdfKH|\V_GGfFGXTu8DON|LohYKIRYKGc- TJwtipPmyX8RoCSCcQAvD_ BwE 


# Washingion Post's Fakeout Series: https:/Avww.youtube.com/watch?v=KwkoFkA2Uo! 
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' Vosoughi, S, et.al. (2018). Tha spread al false information online. Sesrcs (359), 1148-1151 
hips :"science. sciencemag orgcantent/sci/359/6380;1 146 full_pdfl 
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